-- Logs begin at Wed 2022-10-19 20:18:53 UTC, end at Wed 2022-10-19 22:49:18 UTC. -- Oct 19 21:51:48.792561 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 21:51:48.801163 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 21:51:48 2022] *** Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: nodename: dv-cinder-master-3-iscsi Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: machine: x86_64 Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: clock source: unix Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: pcre jit disabled Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: detected number of CPU cores: 4 Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: current working directory: / Oct 19 21:51:48.803844 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: detected binary path: /usr/bin/uwsgi-core Oct 19 21:51:48.804454 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: your processes number limit is 47680 Oct 19 21:51:48.804454 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: your memory page size is 4096 bytes Oct 19 21:51:48.804454 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: detected max file descriptor number: 2048 Oct 19 21:51:48.804454 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: lock engine: pthread robust mutexes Oct 19 21:51:48.804454 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: thunder lock: enabled Oct 19 21:51:48.804454 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 21:51:48.804454 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 21:51:48.842042 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: Python main interpreter initialized at 0x55ee5451a9c0 Oct 19 21:51:48.842042 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: python threads support enabled Oct 19 21:51:48.842042 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: your server socket listen backlog is limited to 100 connections Oct 19 21:51:48.842042 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: your mercy for graceful operations on workers is 90 seconds Oct 19 21:51:48.842356 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 21:51:48.842429 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: *** Operational MODE: preforking *** Oct 19 21:51:48.842693 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: *** uWSGI is running in multiple interpreter mode *** Oct 19 21:51:48.842693 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: spawned uWSGI master process (pid: 105535) Oct 19 21:51:48.842881 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 21:51:48.843451 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: spawned uWSGI worker 1 (pid: 105536, cores: 1) Oct 19 21:51:48.844063 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: spawned uWSGI worker 2 (pid: 105537, cores: 1) Oct 19 21:51:48.844063 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 21:51:49.495973 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 21:51:49.496573 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 21:51:50.572232 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 21:51:50.572232 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: from cryptography.utils import int_from_bytes Oct 19 21:51:50.572948 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 21:51:50.572948 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: from cryptography.utils import int_from_bytes Oct 19 21:51:50.573115 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 21:51:50.573115 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: from cryptography.utils import int_from_bytes Oct 19 21:51:50.573524 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 21:51:50.573524 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: from cryptography.utils import int_from_bytes Oct 19 21:51:53.051856 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 21:51:53.052470 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 21:51:53.052566 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 21:51:53.052881 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 21:51:53.053135 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 21:51:53.053517 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.053782 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 21:51:53.054152 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.054248 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 21:51:53.054328 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.054444 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.054540 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 21:51:53.054767 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.054900 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 21:51:53.055099 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.055196 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 21:51:53.055415 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.055555 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.055728 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.055878 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.056048 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.056197 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.056289 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.056517 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.056616 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.056840 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.056926 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.057152 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.057248 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.057471 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.057557 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.057784 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.057881 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.058097 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.058193 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.058356 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.058441 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.058668 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.058754 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.059007 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.059097 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.059328 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.059496 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.059631 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.060635 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.060782 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.060890 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.060982 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061062 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061199 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061320 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061453 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061453 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061680 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061680 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.061920 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062062 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062200 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062332 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062458 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062586 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062705 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062839 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.062980 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.063158 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.063292 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.063442 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.063578 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.063706 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.063835 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.063957 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.064088 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.064353 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.064482 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.064648 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.064776 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.064954 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.065073 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.065274 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.065450 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.065589 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.065714 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.065890 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.066028 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.066209 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.066345 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.066507 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.066650 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.066821 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.066983 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.067159 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.067297 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.067456 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.067622 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.067749 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.067871 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.068047 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.068179 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.068359 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.068493 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.068658 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.068786 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.068959 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.069088 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.069210 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.069361 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.069489 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.069669 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.069810 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.069975 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.070110 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.070288 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.070422 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.070591 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.070719 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.070851 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.071028 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.071155 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.071287 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.071447 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.071582 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.071766 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.071903 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.072071 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.072277 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.072405 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.072542 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.072675 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.072797 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.072919 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.073052 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.073176 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.073298 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.073468 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.073598 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.073776 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.073904 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.074098 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.074229 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.074379 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.074504 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.074672 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.074806 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.074999 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.075144 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.075317 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.075443 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.075601 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.075736 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.075905 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.076033 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.076213 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.076340 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.076522 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.076656 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.076839 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.076966 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.077139 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.077271 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.077452 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.077580 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.077767 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.077900 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.078069 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.078207 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.078371 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.078511 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.078670 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.078808 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.079025 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.079199 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.079334 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.079456 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.079642 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.079769 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.079899 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.080035 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.080172 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.080300 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.080470 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.080604 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.080781 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.080921 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.081082 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.081215 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.081384 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.081518 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.081685 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.081812 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.081965 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.082099 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.082264 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.082399 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.082560 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.082692 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.082859 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.083017 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.083181 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.083308 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.083481 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.083609 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.083782 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.083909 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.084076 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.084211 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.084374 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.084495 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.084672 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.084799 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.084972 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.085098 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.085276 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.085414 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.085579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.085707 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.085878 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.086013 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.086175 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.086300 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.086472 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.086599 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.086770 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.086999 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.087142 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.087267 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.087396 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.087519 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.087676 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.087825 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.087988 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.088114 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.088285 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.088417 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.088583 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.088725 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.088882 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.089008 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.089185 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.089312 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.089485 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.089618 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.089786 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.089921 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.090076 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.090202 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.090375 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.090510 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.090679 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.090806 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.090994 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.091124 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.091295 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.091435 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.091591 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.091719 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.091886 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.092015 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.092182 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.092322 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.092477 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.092604 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.092775 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.092904 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.093072 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.093207 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.093364 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.093491 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.093660 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.093786 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.093959 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.094094 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.094257 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.094885 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.095108 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.095245 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.095405 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.095532 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.095704 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.095830 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.096001 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.096138 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.096314 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.096442 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.096629 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.096756 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.096933 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.097078 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.097237 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.097364 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.097540 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.097680 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.097854 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 21:51:53.097994 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.098177 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.098303 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.098486 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.098613 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.098808 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.099073 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.099202 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.099325 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.099447 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.099570 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.099707 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.099831 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.100020 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.100155 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.100330 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.100457 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.100656 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.100784 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.100965 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.101092 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.101270 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.101406 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.101578 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.101713 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.101880 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.102008 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.102191 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.102319 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.102504 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.102632 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.102812 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.102938 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.103138 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.103266 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.103452 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.103594 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.103767 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.103902 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.104074 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.104209 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.104389 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.104519 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.104699 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.104825 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.105004 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.105141 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.105307 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.105435 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.105615 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.105752 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.105945 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.106086 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.106251 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.106379 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.106555 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.106689 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.106865 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.107046 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.107194 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.107322 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.107506 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.107633 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.107809 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.107958 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.108113 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.108241 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.108418 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.108544 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.108723 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.108852 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.109025 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.109155 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.109331 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.109458 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.109648 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.109785 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.109976 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.110620 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.110824 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.110979 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.111163 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.111292 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.111473 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.111601 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.111780 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.111909 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.112097 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.112231 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.112405 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.112540 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.112706 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.112835 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.113007 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.113136 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.113305 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.113434 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.113609 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.113749 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.113907 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.114035 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.114219 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.114375 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.114539 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.114676 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.114839 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.115004 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.115185 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.115312 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.115484 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.115625 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.115794 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.115922 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.116093 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.116220 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.116394 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.116528 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.116690 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.116819 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.116993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.117128 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.117297 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.117426 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.117593 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.117721 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.117908 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.118037 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.118212 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.118348 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.118510 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.118647 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.118812 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.118938 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.119134 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.119270 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.119434 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.119562 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.119734 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.119860 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.120036 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.120167 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.120341 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.120475 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.120639 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.120774 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.120942 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.121069 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.121252 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.121384 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.121554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.121758 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.121894 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.122018 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.122162 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.122289 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.122472 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.122607 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.122768 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.122901 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.123131 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.123255 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.123409 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.123549 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.123716 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.123842 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.124015 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.124143 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.124318 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.124448 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.124616 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.124743 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.124914 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.125049 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.125210 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.125346 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.125511 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.125646 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.125837 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.125971 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.126134 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.126263 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.126430 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.126565 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.126724 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.126851 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.127040 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.127181 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.127360 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.127488 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.127658 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.127792 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.127955 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.128081 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.128248 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.128374 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.128541 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.128678 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.128837 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.128964 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.129135 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.129264 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.129453 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.129590 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.129758 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.129885 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.130058 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.130187 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.130358 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.130493 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.130658 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.130793 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.131001 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.131144 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.131302 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.131430 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.131607 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.131742 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.131912 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.132039 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.132217 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.132345 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.132529 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.132663 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.132833 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.132961 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.133144 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.133273 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.133449 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.133576 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.133757 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.133884 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.134058 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.134186 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.134364 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.134489 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.134659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.134785 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.134982 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.135112 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.135300 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.135426 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.135606 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.135755 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.135927 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.136054 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.136236 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.136363 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.136539 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.136674 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.136841 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.136968 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.137141 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.137268 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.137447 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.137590 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.137752 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.137888 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.138054 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.138182 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.138364 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.138499 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.138669 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.138796 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.139008 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.139140 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.139316 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.139446 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.139622 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.139748 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.139924 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.140058 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.140229 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.140356 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.140525 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.140658 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.140831 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.140958 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.141143 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.141269 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.141475 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.141602 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.141783 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.141909 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.142088 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.142222 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.142400 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.142525 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.142697 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.142832 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.143018 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.143147 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.143325 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.143454 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.143623 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.143761 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.143926 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.144065 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.144231 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.144359 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.144538 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.144674 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.144842 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.144978 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.145147 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.145274 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.145443 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.145577 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.145748 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.145874 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.146049 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.146182 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.146347 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.146483 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.146644 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.146771 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.146960 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.147089 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.147279 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.147419 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.147583 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.147726 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.147892 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.148026 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.148199 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.148328 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.148495 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.148620 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.148793 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.148919 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.149104 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.149232 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.149405 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.149533 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.149703 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.149839 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.150034 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.150161 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.150283 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.150413 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.150609 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.150745 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.150909 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.151091 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.151217 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.151346 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.151527 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.151670 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.151836 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.151962 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.152138 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.152267 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.152441 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.152580 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.152773 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.152900 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.153024 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.153146 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.153331 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.153471 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.153637 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.153767 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.153940 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.154076 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.154245 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.154374 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.154550 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.154677 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.154853 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.155010 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.155180 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.155308 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.155495 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.155633 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.155803 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.155929 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.156106 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.156224 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.156409 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.156537 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.156706 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.157347 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.157541 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.157685 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.157853 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.157981 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.158173 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.158408 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.158537 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.158733 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.158860 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.159061 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.159191 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.159378 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.159514 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.159692 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.159831 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.160009 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.160146 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.160332 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.160567 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.160695 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.160898 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.161274 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.161464 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.161604 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.161780 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.161909 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.162077 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.162205 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.162374 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.162512 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.162680 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.162817 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.163008 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.163137 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.163288 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.163416 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.163586 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.163727 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.163890 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.164018 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.164187 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.164315 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.164484 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.164628 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.164780 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.164908 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.165077 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.165205 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.165385 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.165514 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.165683 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.165810 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.165986 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.166112 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.166288 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.166426 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.166590 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.166718 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.166890 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.167035 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.167210 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.167347 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.167508 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.167637 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.167806 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.167935 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.168119 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.168246 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.168421 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.168548 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.168741 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.168878 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.169050 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.169177 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.169352 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.169480 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.169653 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.169789 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.169952 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.170078 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.170271 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.170399 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.170572 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.170709 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.170872 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.171027 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.171193 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.171321 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.171499 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.171637 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.171800 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.171927 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.172098 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.172234 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.172405 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.173108 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.173262 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.173398 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.173569 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.173704 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.173869 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.173997 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.174165 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.174291 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.174469 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.174605 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.174803 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.174928 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.175094 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.175219 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.175387 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.175522 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.175655 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.175791 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.175956 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.176084 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.176263 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.176390 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.176561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.176687 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.176858 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.176986 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.177160 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.177302 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.177456 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.177592 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.177753 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.177880 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.178051 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.178191 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.178348 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.178475 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.178642 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.178770 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.178939 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.179128 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.179430 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.179559 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.179684 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.179808 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.179942 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180068 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180200 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180326 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180449 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180580 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180714 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180840 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.180994 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.181130 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.181294 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.181421 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.181591 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.181719 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.181890 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.182026 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.182204 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.182332 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.182503 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.182630 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.182797 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.182925 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.183123 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.183256 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.183421 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.183548 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.183717 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.183844 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.184013 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.184153 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.184315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.184443 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.184609 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.184744 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.184906 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.185042 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.185201 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.185330 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.185497 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.185626 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.185792 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.185935 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.186090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.186222 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.186394 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.186514 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.186689 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.186816 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.187019 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.187152 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.187299 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.187425 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.187596 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.187725 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.187902 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.188038 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.188250 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.188379 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.188557 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.188687 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.188859 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.188995 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.189162 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.189298 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.189464 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.189593 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.189768 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.189904 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.190075 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.190211 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.190372 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.190501 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.190680 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.190815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.191003 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.191146 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.191312 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.191442 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.191608 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.191735 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.191905 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.192042 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.192220 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.192348 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.192525 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.192661 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.192831 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.192967 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.193138 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.193264 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.193448 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.193577 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.193747 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.193884 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.194045 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.194172 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.194348 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.194477 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.194652 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.194781 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.194988 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.195120 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.195274 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.195415 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.195576 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.195705 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.195880 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.196007 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.196189 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.196316 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.196491 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.196618 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.196795 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.196923 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.197096 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.197225 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.197393 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.197521 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.197692 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.197821 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.197991 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.198128 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.198288 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.198416 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.198592 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.198718 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.198891 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.199053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.199213 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.199341 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.199512 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.199654 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.199809 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.199949 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.200110 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.200237 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.200408 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.200535 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.200725 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.200854 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.201031 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.201159 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.201332 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.201460 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.201637 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.201767 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.201942 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.202076 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.202251 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.202378 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.202580 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.202708 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.202870 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.203041 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.203191 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.203318 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.203580 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.203726 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.203912 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.204041 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.204214 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.204350 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.204520 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.204654 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.204818 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.204946 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.205112 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.205249 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.205415 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.205544 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.205729 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.205858 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.206025 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.206163 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.206327 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.206455 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.206622 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.206749 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.206935 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.207094 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.207250 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.207378 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.207563 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.207691 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.207911 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.208046 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.208213 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.208349 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.208513 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.208641 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.208813 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.208950 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.209129 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.209259 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.209429 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.209556 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.209746 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.209876 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.210118 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.210244 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.210433 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.210568 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.210721 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.210854 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.211054 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.211185 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.211358 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.211499 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.211672 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.211801 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.211986 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.212116 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.212291 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.212420 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.212597 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.212726 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.212921 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.213049 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.213195 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.213324 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.213509 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.213646 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.213813 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.213957 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.214126 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.214255 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.214433 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.214568 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.214745 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.214873 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.215140 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.215270 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.215453 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.215594 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.215769 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.215897 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.216065 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.216199 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.216365 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.216503 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.216668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.216789 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.216965 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.217093 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.217262 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.217399 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.217579 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.217708 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.217879 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.218008 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.218182 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.218311 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.218486 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.218614 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.218788 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.218916 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.219108 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.219246 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.219925 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.220060 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.220246 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.220391 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.220544 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.220673 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.220860 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.220989 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.221170 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.221305 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.221478 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.221606 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.221782 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.221911 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.222079 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.222218 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.222396 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.222522 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.222698 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.222837 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.223018 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.223163 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.223319 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.223448 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.223616 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.223745 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.223954 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.224090 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.224251 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.224377 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.224565 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.224686 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.224874 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.225003 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.225181 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.225323 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.225486 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.225614 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.225792 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.225921 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.226110 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.226229 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.226423 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.226550 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.226732 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.226861 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.227063 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.227195 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.227383 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.227529 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.227680 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.227809 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.227976 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.228111 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.228279 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.228416 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.228579 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.228708 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.228876 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.229004 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.229173 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.229311 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.229474 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.229602 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.229768 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.229896 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.230063 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.230200 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.230357 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.230493 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.230671 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.230800 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.230983 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.231116 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.231289 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.231417 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.231592 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.231719 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.231889 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.232027 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.232185 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.232312 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.232482 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.232610 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.232801 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.232930 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.233101 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.233230 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.233418 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.233553 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.233721 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.233849 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.234024 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.234154 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.234324 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.234462 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.234626 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.234755 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.234946 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.235603 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.235800 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.235946 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.236112 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.236241 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.236423 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.236553 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.236738 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.236875 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.237044 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.237180 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.237354 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.237481 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.237661 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.237801 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.237973 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.238108 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.238287 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.238476 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.238614 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.238800 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.238935 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.239125 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.239251 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.239430 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.239568 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.239738 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.239866 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.240048 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.240176 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.240357 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.240623 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.240753 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.240952 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.241079 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.241255 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.241381 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.241560 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.241689 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.241866 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.241993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.242179 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.242383 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.242514 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.242647 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.242773 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.242897 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.243108 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.243249 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.243419 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.243548 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.243727 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.243848 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.244037 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.244178 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.244355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.244489 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.244679 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.244812 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.244979 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.245108 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.245286 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.245413 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.245593 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.245721 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.245901 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.246031 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.246208 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.246337 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.246513 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.246649 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.246825 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.247005 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.247153 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.247291 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.247458 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.247595 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.247760 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.247897 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.248070 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.248197 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.248376 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.248503 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.248683 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.248810 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.248995 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.249124 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.249306 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.249435 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.249610 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.249737 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.249914 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.250041 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.250219 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.250346 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.250526 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.250745 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.250874 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.251139 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.251271 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.251466 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.251596 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.251784 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.251912 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.252099 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.252228 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.252408 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.252544 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.252718 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.252937 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.253077 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.253254 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.253384 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.253587 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.253715 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.253900 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.254036 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.254202 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.254330 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.254499 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.254627 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.254813 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.254942 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.255141 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.255281 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.255440 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.255569 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.255742 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.255878 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.256042 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.256169 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.256347 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.256561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.256698 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.256902 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.257029 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.257216 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.257343 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.257534 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.257671 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.257852 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.257979 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.258160 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.258286 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.258461 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.258689 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.258818 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.259050 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.259182 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.259368 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.259509 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.259678 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.259806 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.259984 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.260120 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.260283 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.260421 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.260567 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.260694 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.260873 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.261002 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.261175 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.261313 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.261472 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.261601 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.261774 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.261902 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.262073 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.262202 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.262371 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.262507 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.262675 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.262805 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.262991 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.263121 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.263294 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.263430 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.263597 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.263724 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.263893 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.264022 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.264191 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.264319 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.264489 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.264618 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.264784 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.264915 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.265090 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.265218 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.265387 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.265525 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.265688 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.265830 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.265984 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.266119 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.266312 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.266456 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.266664 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.266910 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.267101 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.267316 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.267444 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.267634 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.267882 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.268012 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.268218 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.268346 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.268530 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.268808 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.268951 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.269118 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.269254 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.269428 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.269564 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.269734 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.269863 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.270075 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.270202 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.270379 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.270514 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.270699 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.270897 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.271066 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.271247 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.271409 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.271613 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.271741 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.271865 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.271996 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.272182 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.272312 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.272483 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.272613 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.272781 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.272926 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.273079 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.273222 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.273394 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.273523 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.273696 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.273956 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.274085 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.274288 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.274413 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.274589 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.274747 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.274894 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.275076 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.275223 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.275353 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.275543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.275670 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.275818 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.275956 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.276123 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.276251 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.276427 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.276568 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.276734 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.276877 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.277035 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.277161 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.277336 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.277465 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.277638 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.277774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.277943 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.278069 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.278252 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.278380 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.278566 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.278708 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.278872 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.279018 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.279200 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.279322 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.279505 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.279634 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.279805 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.279939 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.280109 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.280235 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.280409 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.280545 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.280713 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.280846 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.281019 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.281145 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.281341 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.281472 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.281647 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.281775 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.282471 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.282608 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.282794 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.283136 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.283267 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.283445 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.283574 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.283764 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.283928 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.284083 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.284244 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.284392 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.284710 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.285028 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.285335 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.285624 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.285753 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.285942 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.286519 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.286851 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.287202 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.287520 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.287723 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.287864 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.288087 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.288219 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.288399 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.288705 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.289018 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.289324 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.289570 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.289822 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.289951 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.290346 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.290590 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.290897 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.291081 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.291274 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.291470 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.291598 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.291922 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.292057 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.292258 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.292562 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.292690 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.292904 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.293131 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.293269 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.293538 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.293710 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.293874 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.294217 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.294337 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.294551 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.294823 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.294973 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.295201 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.295415 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.295552 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.295808 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.295976 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.296112 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.296429 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.296557 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.296744 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.297048 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.297175 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.297353 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.298205 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.298369 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.298692 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.298820 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.299034 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.299348 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.299489 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.299660 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.299903 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.300024 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.300267 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.300393 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.300574 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.300711 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.300880 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.301270 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.301413 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.301612 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.301746 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.301963 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.302100 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.302226 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.302351 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.302523 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.302652 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.302830 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.302979 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.303162 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.303291 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.303469 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.303608 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.303772 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.303901 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.304102 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.304232 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.304420 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.304556 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.304735 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.304869 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.305051 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.305178 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.305361 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.305496 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.305670 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.305798 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.305979 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.306106 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.306285 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.306488 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.306616 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.306741 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.306905 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.307048 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.307237 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.307366 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.307548 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.307675 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.307864 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.307999 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.308176 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.308305 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.308488 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.308617 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.308796 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.308926 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.309104 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.309239 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.309412 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.309546 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.309727 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.309867 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.310036 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.310156 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.310342 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.310470 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.310648 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.310787 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.310994 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.311128 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.311294 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.311423 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.311602 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.311743 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.311910 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.312041 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.312221 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.312349 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.312532 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.312670 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.312844 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.312973 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.313183 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.313367 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.313503 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.313628 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.313791 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.313919 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.314106 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.314235 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.314417 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.314572 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.314728 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.314864 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.315068 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.315200 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.315382 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.315519 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.315701 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.315832 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.316010 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.316157 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.316311 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.316439 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.316563 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 21:51:53.316732 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.317062 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.317407 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.317720 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.318063 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.318393 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.318708 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.319044 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.319351 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 21:51:53.319596 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 21:51:53.468810 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO dbcounter [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Registered counter for database nova_api Oct 19 21:51:53.472476 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO dbcounter [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Registered counter for database nova_api Oct 19 21:51:53.489951 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.491627 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_db.sqlalchemy.engines [None req-72536746-f499-4187-b322-016874c7e0e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.496601 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writer thread running {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:53.498143 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writer thread running {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:53.553987 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.context [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96479bbc-106d-47fa-b01e-302825761e12(cell1) {{(pid=105537) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 21:51:53.555421 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.context [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96479bbc-106d-47fa-b01e-302825761e12(cell1) {{(pid=105536) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 21:51:53.557772 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 21:51:53.558246 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 21:51:53.559254 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_concurrency.lockutils [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 21:51:53.559730 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_concurrency.lockutils [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 21:51:53.559818 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 21:51:53.560548 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 21:51:53.560988 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 21:51:53.561313 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_concurrency.lockutils [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 21:51:53.562043 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_concurrency.lockutils [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 21:51:53.562488 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_concurrency.lockutils [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 21:51:53.562972 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 21:51:53.564490 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_concurrency.lockutils [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 21:51:53.564977 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO dbcounter [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Registered counter for database nova_cell0 Oct 19 21:51:53.566472 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO dbcounter [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Registered counter for database nova_cell0 Oct 19 21:51:53.568964 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO dbcounter [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Registered counter for database nova_cell1 Oct 19 21:51:53.570475 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO dbcounter [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Registered counter for database nova_cell1 Oct 19 21:51:53.576210 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.578393 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_db.sqlalchemy.engines [None req-72536746-f499-4187-b322-016874c7e0e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.581393 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writer thread running {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:53.582621 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_db.sqlalchemy.engines [None req-72536746-f499-4187-b322-016874c7e0e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.582919 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.584142 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writer thread running {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:53.723843 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writer thread running {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:53.726277 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writer thread running {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:53.732416 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO dbcounter [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Registered counter for database nova_cell0 Oct 19 21:51:53.734724 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO dbcounter [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Registered counter for database nova_cell0 Oct 19 21:51:53.741295 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_db.sqlalchemy.engines [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.744693 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG oslo_db.sqlalchemy.engines [None req-72536746-f499-4187-b322-016874c7e0e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 21:51:53.746055 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writer thread running {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:53.749343 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writer thread running {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 21:51:54.202259 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: WARNING keystonemiddleware.auth_token [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 21:51:54.209496 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: WARNING keystonemiddleware.auth_token [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 21:51:54.220236 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: WARNING keystonemiddleware.auth_token [None req-72536746-f499-4187-b322-016874c7e0e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 21:51:54.227406 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: WARNING keystonemiddleware.auth_token [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 21:51:54.551094 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: WARNING keystonemiddleware.auth_token [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 21:51:54.556991 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: WARNING keystonemiddleware.auth_token [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 21:51:54.562253 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee5451a9c0 pid: 105537 (default app) Oct 19 21:51:54.564357 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:51:54.565555 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Oct 19 21:51:54.565932 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: WARNING keystonemiddleware.auth_token [None req-72536746-f499-4187-b322-016874c7e0e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 21:51:54.566031 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Oct 19 21:51:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:51:54.572061 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: WARNING keystonemiddleware.auth_token [None req-72536746-f499-4187-b322-016874c7e0e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 21:51:54.577316 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ee5451a9c0 pid: 105536 (default app) Oct 19 21:53:18.353534 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:18.355347 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002278 Oct 19 21:53:18.363241 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:18 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:18.369122 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writing DB stats nova_api:SELECT=3 {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:18.370416 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writing DB stats nova_cell0:SELECT=3 {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:18.371431 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writing DB stats nova_cell1:SELECT=3 {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:18.373369 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:19.240518 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-28a2cfca-b048-4e9e-b80e-f0b393759b01 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:19.274473 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-28a2cfca-b048-4e9e-b80e-f0b393759b01 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910974 Oct 19 21:53:19.275246 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 19 21:53:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:21.872923 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:21.873875 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-a6f59007-be7a-49ef-9902-3f8533654790 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Oct 19 21:53:21.879235 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:21 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:22.318520 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-a5258e3a-29f5-4401-992a-1c5a04812752 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "swap": 0}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:22.423968 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-a5258e3a-29f5-4401-992a-1c5a04812752 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.541035 Oct 19 21:53:22.424534 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:53:22.438680 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_api:SELECT=3 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:22.439556 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_cell0:SELECT=3 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:22.441500 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_cell1:SELECT=3 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:22.442285 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:22.647113 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-31772370-c45b-4c38-a133-3a67779f05bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:22.785233 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-31772370-c45b-4c38-a133-3a67779f05bd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352217 Oct 19 21:53:22.785835 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 19 21:53:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:25.400309 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-a5258e3a-29f5-4401-992a-1c5a04812752 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:25.401421 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-a5258e3a-29f5-4401-992a-1c5a04812752 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 19 21:53:25.401974 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:26.051303 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-d019f544-4fba-4402-8caa-823254c2ed58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:26.184176 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-d019f544-4fba-4402-8caa-823254c2ed58 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.776034 Oct 19 21:53:26.185025 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:53:26.196750 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-c3d7859f-c963-4219-b71f-bf0cb1e384c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:26.301480 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-c3d7859f-c963-4219-b71f-bf0cb1e384c1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108082 Oct 19 21:53:26.303055 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 19 21:53:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:28.880759 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-d019f544-4fba-4402-8caa-823254c2ed58 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:28.881770 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-d019f544-4fba-4402-8caa-823254c2ed58 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 19 21:53:28.882206 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:29.296739 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-b51c61a0-4ea6-4fb8-addb-1597725bc6a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "swap": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:29.393893 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-b51c61a0-4ea6-4fb8-addb-1597725bc6a8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503085 Oct 19 21:53:29.393893 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:53:29.404997 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-98d20671-d462-4935-924b-224429a42f00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:29.490896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-98d20671-d462-4935-924b-224429a42f00 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090059 Oct 19 21:53:29.491571 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 19 21:53:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:32.082819 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-b51c61a0-4ea6-4fb8-addb-1597725bc6a8 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:32.083879 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-b51c61a0-4ea6-4fb8-addb-1597725bc6a8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 19 21:53:32.084282 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:32.502874 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-021c129d-c781-43fe-8178-5a49de5a127e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:32.589187 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-021c129d-c781-43fe-8178-5a49de5a127e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498840 Oct 19 21:53:32.589744 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:53:32.601868 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-89a9ecb9-9061-4f67-bbbc-3c8e310e59e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:32.702595 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-89a9ecb9-9061-4f67-bbbc-3c8e310e59e2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104165 Oct 19 21:53:32.717055 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 19 21:53:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:35.331469 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-021c129d-c781-43fe-8178-5a49de5a127e admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:35.332675 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-021c129d-c781-43fe-8178-5a49de5a127e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Oct 19 21:53:35.333167 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:35.757527 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-2ce43193-bf31-41bf-885b-62936269e868 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:35.854837 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-2ce43193-bf31-41bf-885b-62936269e868 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515296 Oct 19 21:53:35.855480 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 21:53:35.868327 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-95ca1e61-8940-4a21-a9e1-f30551db5e74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:35.949935 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-95ca1e61-8940-4a21-a9e1-f30551db5e74 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085346 Oct 19 21:53:35.957010 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Oct 19 21:53:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 21:53:38.566033 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-2ce43193-bf31-41bf-885b-62936269e868 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:38.567127 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-2ce43193-bf31-41bf-885b-62936269e868 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 19 21:53:38.567544 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:39.009879 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-c8c8185c-fea3-40cd-adac-013a7e62321a admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:39.037807 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-c8c8185c-fea3-40cd-adac-013a7e62321a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463606 Oct 19 21:53:39.038644 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 19 21:53:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 21:53:41.659082 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-2ce43193-bf31-41bf-885b-62936269e868 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:41.660724 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-2ce43193-bf31-41bf-885b-62936269e868 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Oct 19 21:53:41.661127 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:42.058439 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-0e457a11-2d2e-402e-ad9c-0f0bd4f75d9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "swap": 0, "id": "1", "ram": 512}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:42.143301 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-0e457a11-2d2e-402e-ad9c-0f0bd4f75d9b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.475880 Oct 19 21:53:42.143866 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:53:42.155989 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-945e1ffa-5e42-43f1-947a-1644b0ab479f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:42.232540 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-945e1ffa-5e42-43f1-947a-1644b0ab479f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080237 Oct 19 21:53:42.233102 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 19 21:53:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:44.814211 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-0e457a11-2d2e-402e-ad9c-0f0bd4f75d9b admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:44.815283 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-0e457a11-2d2e-402e-ad9c-0f0bd4f75d9b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 19 21:53:44.815696 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:45.213988 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-59b40ff9-d6cf-47cb-9849-88e06c55ace0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "id": "2"}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:45.309361 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-59b40ff9-d6cf-47cb-9849-88e06c55ace0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.487553 Oct 19 21:53:45.309948 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:53:45.322958 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-fe4def4e-16c7-4872-9ad2-3eb7a471d3b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:45.429671 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-fe4def4e-16c7-4872-9ad2-3eb7a471d3b8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110357 Oct 19 21:53:45.430592 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 19 21:53:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:48.045193 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-59b40ff9-d6cf-47cb-9849-88e06c55ace0 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:48.046216 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-59b40ff9-d6cf-47cb-9849-88e06c55ace0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 19 21:53:48.046627 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:48.510755 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-00bf286e-206b-42a0-93a6-a5ee6ed07073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "swap": 0}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:48.591477 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-00bf286e-206b-42a0-93a6-a5ee6ed07073 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.537949 Oct 19 21:53:48.591964 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 21:53:48.604922 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-52846a6b-a617-4365-b5cf-f9d39a3d53da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:48.611147 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:53:48.705502 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-52846a6b-a617-4365-b5cf-f9d39a3d53da admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104956 Oct 19 21:53:48.719448 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 19 21:53:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:53:51.346757 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-00bf286e-206b-42a0-93a6-a5ee6ed07073 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:51.347720 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-00bf286e-206b-42a0-93a6-a5ee6ed07073 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 19 21:53:51.348398 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:51.802505 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-15ad8bfc-08a9-4497-992c-360e1411fb37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:51.869757 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-15ad8bfc-08a9-4497-992c-360e1411fb37 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.515594 Oct 19 21:53:51.870351 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:53:51.883168 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-4fa2ebfe-1abf-49ba-b54d-e1237479dd51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:51.952862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-4fa2ebfe-1abf-49ba-b54d-e1237479dd51 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073401 Oct 19 21:53:51.954574 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 19 21:53:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 21:53:54.578937 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-15ad8bfc-08a9-4497-992c-360e1411fb37 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:53:54.579970 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-15ad8bfc-08a9-4497-992c-360e1411fb37 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Oct 19 21:53:54.580370 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:53:55.014869 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-c4805ebe-cd95-44e8-b3b4-011b76154560 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:55.096750 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-c4805ebe-cd95-44e8-b3b4-011b76154560 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.509928 Oct 19 21:53:55.097653 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Oct 19 21:53:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 21:53:55.110100 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-27d74a11-c81c-4ff9-8608-4068bec0fb83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:53:55.218411 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-27d74a11-c81c-4ff9-8608-4068bec0fb83 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112677 Oct 19 21:53:55.219923 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Oct 19 21:53:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:54:11.740461 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-c4805ebe-cd95-44e8-b3b4-011b76154560 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:11.741480 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-c4805ebe-cd95-44e8-b3b4-011b76154560 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 19 21:54:11.741887 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:54:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:11.752245 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:54:12.127901 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-2e79d447-f56e-40cf-be89-4222adcb7667 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:12.145435 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-2e79d447-f56e-40cf-be89-4222adcb7667 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397647 Oct 19 21:54:12.145968 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 19 21:54:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:54:13.444025 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-c4805ebe-cd95-44e8-b3b4-011b76154560 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:13.445038 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-c4805ebe-cd95-44e8-b3b4-011b76154560 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 19 21:54:13.445461 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:13.964182 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-2542ec62-d91b-4c4b-905d-0b165cd7188f admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:13.970163 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.wsgi [None req-2542ec62-d91b-4c4b-905d-0b165cd7188f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-2542ec62-d91b-4c4b-905d-0b165cd7188f admin admin] Request method failure captured: Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Accept: application/json Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Accept-Encoding: gzip, deflate Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Connection: keep-alive Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Content-Length: 0 Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Host: 10.222.0.20 Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Openstack-Api-Version: compute 2.92 Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Openstack-System-Scope: None Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: User-Agent: python-novaclient Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Auth-Token: gAAAAABjUHIF67o-uOpORF8J588oL_Fll-sgBBNr4uMpTY-wWeQsGwoGr38zEfLpAcDrOWtdKzXSbAQAnAQzjbxoLlYHRU7X-cIzikIkpbnrH30DUOlcreCAcLVMbSEP7ma_WYXzm4PZalKftoth99ejfPQv_hYHB_s6EC5qJUVmq4aAdEiAHTw Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Domain-Id: None Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Domain-Name: None Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Identity-Status: Confirmed Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Is-Admin-Project: True Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Domain-Id: default Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Domain-Name: Default Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Name: admin Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Role: reader,member,admin Oct 19 21:54:13.973390 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Roles: reader,member,admin Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}] Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant: admin Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant-Name: admin Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User: admin Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Domain-Id: default Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Domain-Name: Default Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Id: 4cc834c20ef040c19350af5fc47f4735 Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Name: admin Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: method: > Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: exception: Flavor 42 could not be found. Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: action_args: {'id': '42'} Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 21:54:13.975090 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:13.976105 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:13.977498 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-2542ec62-d91b-4c4b-905d-0b165cd7188f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 21:54:13.978809 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-2542ec62-d91b-4c4b-905d-0b165cd7188f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392360 Oct 19 21:54:13.978809 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 19 21:54:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 21:54:13.984700 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-8e8c60b9-295b-4596-a5c8-bda2064233b2 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:13.988968 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:54:14.007804 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-8e8c60b9-295b-4596-a5c8-bda2064233b2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026612 Oct 19 21:54:14.008405 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 19 21:54:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:54:14.019892 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-20ddb54f-0288-4b2f-a129-e186b398711b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:14.042400 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-20ddb54f-0288-4b2f-a129-e186b398711b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027828 Oct 19 21:54:14.042945 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 19 21:54:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:54:14.052669 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-d3ae8da2-f16c-47ff-969a-1069266278ea admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:14.058096 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.wsgi [None req-d3ae8da2-f16c-47ff-969a-1069266278ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-d3ae8da2-f16c-47ff-969a-1069266278ea admin admin] Request method failure captured: Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Accept: application/json Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Accept-Encoding: gzip, deflate Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Connection: keep-alive Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Content-Length: 0 Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Host: 10.222.0.20 Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Openstack-Api-Version: compute 2.92 Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Openstack-System-Scope: None Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: User-Agent: python-novaclient Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Auth-Token: gAAAAABjUHIF67o-uOpORF8J588oL_Fll-sgBBNr4uMpTY-wWeQsGwoGr38zEfLpAcDrOWtdKzXSbAQAnAQzjbxoLlYHRU7X-cIzikIkpbnrH30DUOlcreCAcLVMbSEP7ma_WYXzm4PZalKftoth99ejfPQv_hYHB_s6EC5qJUVmq4aAdEiAHTw Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Domain-Id: None Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Domain-Name: None Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Identity-Status: Confirmed Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Is-Admin-Project: True Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Domain-Id: default Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Domain-Name: Default Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Name: admin Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Role: reader,member,admin Oct 19 21:54:14.064543 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Roles: reader,member,admin Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}] Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant: admin Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant-Name: admin Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User: admin Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Domain-Id: default Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Domain-Name: Default Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Id: 4cc834c20ef040c19350af5fc47f4735 Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Name: admin Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: method: > Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: exception: Flavor 42 could not be found. Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: action_args: {'id': '42'} Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 21:54:14.065811 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:14.066561 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:14.067659 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-d3ae8da2-f16c-47ff-969a-1069266278ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 21:54:14.068942 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-d3ae8da2-f16c-47ff-969a-1069266278ea admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014070 Oct 19 21:54:14.068942 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 19 21:54:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 21:54:15.274218 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-20ddb54f-0288-4b2f-a129-e186b398711b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:15.275248 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-20ddb54f-0288-4b2f-a129-e186b398711b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 19 21:54:15.275676 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:15.793068 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-72391083-f24b-456f-b449-496eb705cf57 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:15.798069 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.wsgi [None req-72391083-f24b-456f-b449-496eb705cf57 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-72391083-f24b-456f-b449-496eb705cf57 admin admin] Request method failure captured: Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Accept: application/json Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Accept-Encoding: gzip, deflate Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Connection: keep-alive Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Content-Length: 0 Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Host: 10.222.0.20 Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Openstack-Api-Version: compute 2.92 Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Openstack-System-Scope: None Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: User-Agent: python-novaclient Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Auth-Token: gAAAAABjUHIHJJIS4vtHHAY-FGvwktcPTKDOcO6eDn9oUln77U5l5ZeqUE3qxiAaMfO_acbzqYgXD8l4FzMfcdgnoFnE9KO-oBVjcXrHyGmksGJQcP8mNQhQN3NN4XHnhLqSO7eIE5cxbKH4R87TbVgnzT-QNUcgybbpS7XZ93HwouP_qqY09WE Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Domain-Id: None Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Domain-Name: None Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Identity-Status: Confirmed Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Is-Admin-Project: True Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Domain-Id: default Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Domain-Name: Default Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Name: admin Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Role: reader,member,admin Oct 19 21:54:15.799600 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Roles: reader,member,admin Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}] Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant: admin Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant-Name: admin Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User: admin Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Domain-Id: default Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Domain-Name: Default Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Id: 4cc834c20ef040c19350af5fc47f4735 Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Name: admin Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: method: > Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: exception: Flavor 84 could not be found. Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: action_args: {'id': '84'} Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 21:54:15.800993 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:15.801862 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.802896 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-72391083-f24b-456f-b449-496eb705cf57 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 21:54:15.803917 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-72391083-f24b-456f-b449-496eb705cf57 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388406 Oct 19 21:54:15.803917 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 19 21:54:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 21:54:15.810913 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-473b9d1d-619a-407d-b3b8-b8d73779f173 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:15.826136 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-473b9d1d-619a-407d-b3b8-b8d73779f173 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018831 Oct 19 21:54:15.826664 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 19 21:54:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:54:15.836428 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-feea705e-3658-45f7-b149-39f95bf2f297 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:15.851309 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-feea705e-3658-45f7-b149-39f95bf2f297 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018331 Oct 19 21:54:15.851816 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 19 21:54:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:54:15.861195 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-cf96bf19-9e1d-4e5d-a709-c689aaaa8505 admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:15.866014 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.wsgi [None req-cf96bf19-9e1d-4e5d-a709-c689aaaa8505 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-cf96bf19-9e1d-4e5d-a709-c689aaaa8505 admin admin] Request method failure captured: Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Accept: application/json Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Accept-Encoding: gzip, deflate Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Connection: keep-alive Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Content-Length: 0 Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Host: 10.222.0.20 Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Openstack-Api-Version: compute 2.92 Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Openstack-System-Scope: None Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: User-Agent: python-novaclient Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Auth-Token: gAAAAABjUHIHJJIS4vtHHAY-FGvwktcPTKDOcO6eDn9oUln77U5l5ZeqUE3qxiAaMfO_acbzqYgXD8l4FzMfcdgnoFnE9KO-oBVjcXrHyGmksGJQcP8mNQhQN3NN4XHnhLqSO7eIE5cxbKH4R87TbVgnzT-QNUcgybbpS7XZ93HwouP_qqY09WE Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Domain-Id: None Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Domain-Name: None Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Identity-Status: Confirmed Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Is-Admin-Project: True Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Domain-Id: default Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Domain-Name: Default Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Name: admin Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Role: reader,member,admin Oct 19 21:54:15.867554 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Roles: reader,member,admin Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}] Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant: admin Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant-Name: admin Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User: admin Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Domain-Id: default Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Domain-Name: Default Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Id: 4cc834c20ef040c19350af5fc47f4735 Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Name: admin Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: method: > Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: exception: Flavor 84 could not be found. Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: action_args: {'id': '84'} Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 21:54:15.868815 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:15.869579 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:15.870774 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-cf96bf19-9e1d-4e5d-a709-c689aaaa8505 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 21:54:15.872020 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-cf96bf19-9e1d-4e5d-a709-c689aaaa8505 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011644 Oct 19 21:54:15.872020 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Oct 19 21:54:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 21:54:17.085778 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-feea705e-3658-45f7-b149-39f95bf2f297 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:17.086776 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-feea705e-3658-45f7-b149-39f95bf2f297 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 19 21:54:17.087213 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:17.605436 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ef1997d1-0557-44c4-ba68-cf0c2e12f96e admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:17.611569 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.wsgi [None req-ef1997d1-0557-44c4-ba68-cf0c2e12f96e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ef1997d1-0557-44c4-ba68-cf0c2e12f96e admin admin] Request method failure captured: Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Accept: application/json Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Accept-Encoding: gzip, deflate Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Connection: keep-alive Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Content-Length: 0 Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Host: 10.222.0.20 Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Openstack-Api-Version: compute 2.92 Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Openstack-System-Scope: None Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: User-Agent: python-novaclient Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Auth-Token: gAAAAABjUHIIFtclSKiOqOlRa2pvzh6d2LsAlgUNKEbB744UHAVFfKHeQ6WzNn887WIr-jmn9sB7F71OGf5bw5_MpfHC2ajtgc0c64ZACtp0SF__v3NFDAkST-nPo9tUA8qXfcT517KclKYQVBau6v2GIDKjKLaqcWrUqe8N6H4WCqTiobZicak Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Domain-Id: None Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Domain-Name: None Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Identity-Status: Confirmed Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Is-Admin-Project: True Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Domain-Id: default Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Domain-Name: Default Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Project-Name: admin Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Role: reader,member,admin Oct 19 21:54:17.613053 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Roles: reader,member,admin Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}] Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant: admin Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-Tenant-Name: admin Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User: admin Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Domain-Id: default Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Domain-Name: Default Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Id: 4cc834c20ef040c19350af5fc47f4735 Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: X-User-Name: admin Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: method: > Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: exception: Flavor 451 could not be found. Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: action_args: {'id': '451'} Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 21:54:17.614541 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:17.615355 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.616388 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ef1997d1-0557-44c4-ba68-cf0c2e12f96e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 21:54:17.617408 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ef1997d1-0557-44c4-ba68-cf0c2e12f96e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389570 Oct 19 21:54:17.617408 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 19 21:54:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 21:54:17.624351 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-16771ffa-16b2-4b7e-b144-216eeee55912 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:17.639400 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-16771ffa-16b2-4b7e-b144-216eeee55912 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018843 Oct 19 21:54:17.639913 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 19 21:54:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:54:17.648775 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:17.663136 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017706 Oct 19 21:54:17.663650 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Oct 19 21:54:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:54:17.673288 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-0915dc0f-c790-4d5a-9490-caad36d405b6 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:17.678134 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.wsgi [None req-0915dc0f-c790-4d5a-9490-caad36d405b6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-0915dc0f-c790-4d5a-9490-caad36d405b6 admin admin] Request method failure captured: Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Accept: application/json Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Accept-Encoding: gzip, deflate Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Connection: keep-alive Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Content-Length: 0 Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Host: 10.222.0.20 Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Openstack-Api-Version: compute 2.92 Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Openstack-System-Scope: None Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: User-Agent: python-novaclient Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Auth-Token: gAAAAABjUHIIFtclSKiOqOlRa2pvzh6d2LsAlgUNKEbB744UHAVFfKHeQ6WzNn887WIr-jmn9sB7F71OGf5bw5_MpfHC2ajtgc0c64ZACtp0SF__v3NFDAkST-nPo9tUA8qXfcT517KclKYQVBau6v2GIDKjKLaqcWrUqe8N6H4WCqTiobZicak Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Domain-Id: None Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Domain-Name: None Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Identity-Status: Confirmed Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Is-Admin-Project: True Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Domain-Id: default Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Domain-Name: Default Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Project-Name: admin Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Role: reader,member,admin Oct 19 21:54:17.679668 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Roles: reader,member,admin Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0fd8fb8e58c74c8cbe244194ce71b304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0fd8fb8e58c74c8cbe244194ce71b304"}]}] Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant: admin Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant-Id: 0fd8fb8e58c74c8cbe244194ce71b304 Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-Tenant-Name: admin Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User: admin Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Domain-Id: default Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Domain-Name: Default Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Id: 4cc834c20ef040c19350af5fc47f4735 Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: X-User-Name: admin Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: method: > Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: exception: Flavor 451 could not be found. Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: action_args: {'id': '451'} Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 21:54:17.681203 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:17.682315 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: ERROR nova.api.openstack.wsgi Oct 19 21:54:17.683603 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-0915dc0f-c790-4d5a-9490-caad36d405b6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 21:54:17.684872 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-0915dc0f-c790-4d5a-9490-caad36d405b6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011721 Oct 19 21:54:17.684872 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 19 21:54:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 21:54:18.901912 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:18.902919 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 19 21:54:18.903364 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:19.422403 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-328cad3b-e375-48ff-804c-78dcf9a39e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:54:19.491835 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-328cad3b-e375-48ff-804c-78dcf9a39e58 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.447394 Oct 19 21:54:19.492384 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 19 21:54:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:54:20.693842 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:20.694843 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 19 21:54:20.695265 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:21.205557 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-5602ffd7-05b1-427f-8619-737e1deb780f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:54:21.291161 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-5602ffd7-05b1-427f-8619-737e1deb780f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.458527 Oct 19 21:54:21.291714 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 19 21:54:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:54:22.505002 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:22.506119 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 19 21:54:22.506515 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:23.023897 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-2981fbf2-757b-4b26-bf92-21530c1ae39b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:54:23.093200 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-2981fbf2-757b-4b26-bf92-21530c1ae39b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.449548 Oct 19 21:54:23.094256 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 19 21:54:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:54:24.301200 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:24.302193 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 19 21:54:24.302589 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:24.822392 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-0fdb6c5d-b0e6-4865-9d6e-0d0eaa357bfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 21:54:24.897170 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-0fdb6c5d-b0e6-4865-9d6e-0d0eaa357bfc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.454253 Oct 19 21:54:24.897729 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Oct 19 21:54:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 21:54:26.109630 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:26.110640 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 19 21:54:26.111067 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 21:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:54:26.632576 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-524042ba-f9e1-4704-b66b-cb3076f03c27 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:54:26.653104 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-524042ba-f9e1-4704-b66b-cb3076f03c27 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406087 Oct 19 21:54:26.653585 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Oct 19 21:54:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:55:22.693534 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:55:22.694566 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-ab02379b-e63d-40af-902b-6d00a64b167b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 19 21:55:22.694997 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Wed Oct 19 21:55:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 21:55:22.705941 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:55:23.084361 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-6cb57ad9-c011-44de-b44b-e494249f3543 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:55:23.104365 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-6cb57ad9-c011-44de-b44b-e494249f3543 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403363 Oct 19 21:55:23.104919 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Oct 19 21:55:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 21:55:23.127384 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG dbcounter [-] [105536] Writing DB stats nova_api:SELECT=14 {{(pid=105536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 21:55:23.131113 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-9e640c43-957e-4c03-a347-84f824645fed admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:55:23.138336 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-9e640c43-957e-4c03-a347-84f824645fed admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012386 Oct 19 21:55:23.138858 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Oct 19 21:55:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:55:23.151241 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-7ad8bcd5-35f5-4a73-b9a4-fc4c26c86141 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:55:23.158402 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-7ad8bcd5-35f5-4a73-b9a4-fc4c26c86141 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010695 Oct 19 21:55:23.158927 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Oct 19 21:55:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:55:23.170198 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:55:23.177206 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010388 Oct 19 21:55:23.177717 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Oct 19 21:55:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 21:55:23.189239 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-2ccd373e-5600-45d1-86b1-7a5f92bb5d44 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 21:55:23.196252 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-2ccd373e-5600-45d1-86b1-7a5f92bb5d44 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010879 Oct 19 21:55:23.196758 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Oct 19 21:55:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:00:02.286616 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:02.287655 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 19 22:00:02.288051 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 22:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:00:02.430093 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_api:SELECT=6 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:00:02.582844 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:02.587580 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:02.588052 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:02.588476 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:02.589184 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:02.589626 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:02.590041 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:02.621373 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-a9133c2e-3f57-4b3d-b79e-65a48ada20fd admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.192443 Oct 19 22:00:02.621916 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 19 22:00:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:00:03.703851 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:03.704848 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 19 22:00:03.705245 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 22:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:00:03.895873 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:03.899475 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:03.899961 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:03.900384 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:03.901086 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:03.901526 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:03.901962 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:03.922684 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-e11bbb6f-10ca-4f3b-8781-ba4fd2d8e762 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079012 Oct 19 22:00:03.923464 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 19 22:00:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:00:15.407691 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:15.409229 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 Oct 19 22:00:15.409631 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 22:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:00:15.552531 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_cell0:SELECT=4 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:00:15.553267 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_cell1:SELECT=4 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:00:15.553892 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG dbcounter [-] [105537] Writing DB stats nova_api:SELECT=8 {{(pid=105537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:00:15.602148 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:15.605559 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:15.607174 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:15.607174 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:15.607174 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:15.607586 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:15.607999 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:15.637889 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-c19e4b1a-ae60-4aff-a0dd-3ef9c1b9affd admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085913 Oct 19 22:00:15.637889 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 19 22:00:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:00:16.713649 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: DEBUG nova.api.openstack.wsgi [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] Calling method '>' {{(pid=105536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:16.714650 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: INFO nova.api.openstack.requestlog [None req-a701c7d1-3eec-4130-b1c9-6b436adcd86d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Oct 19 22:00:16.715079 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: [pid: 105536|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Oct 19 22:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:00:16.903243 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG nova.api.openstack.wsgi [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] Calling method '>' {{(pid=105537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:00:16.906612 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:16.907139 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:16.907565 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:16.908817 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:00:16.909259 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:00:16.909674 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: DEBUG oslo_concurrency.lockutils [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:00:16.931754 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: INFO nova.api.openstack.requestlog [None req-53248ad1-a50b-4288-911d-65b4d78cd04a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079456 Oct 19 22:00:16.932209 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: [pid: 105537|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Oct 19 22:00:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:01:14.421398 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 22:01:14.421954 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: Wed Oct 19 22:01:14 2022 - graceful shutdown triggered... Oct 19 22:01:14.422428 dv-cinder-master-3-iscsi devstack@n-api.service[105536]: Gracefully killing worker 1 (pid: 105536)... Oct 19 22:01:14.422803 dv-cinder-master-3-iscsi devstack@n-api.service[105537]: Gracefully killing worker 2 (pid: 105537)... Oct 19 22:01:15.423156 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: worker 1 buried after 1 seconds Oct 19 22:01:15.423156 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: worker 2 buried after 1 seconds Oct 19 22:01:15.423156 dv-cinder-master-3-iscsi devstack@n-api.service[105535]: goodbye to uWSGI. Oct 19 22:01:15.424680 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 19 22:01:15.425497 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 22:01:15.428363 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 22:01:15.437486 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 22:01:15.440071 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 22:01:15 2022] *** Oct 19 22:01:15.440237 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 22:01:15.440373 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: nodename: dv-cinder-master-3-iscsi Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: machine: x86_64 Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: clock source: unix Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: pcre jit disabled Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: detected number of CPU cores: 4 Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: current working directory: / Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: detected binary path: /usr/bin/uwsgi-core Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: your processes number limit is 47680 Oct 19 22:01:15.440502 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: your memory page size is 4096 bytes Oct 19 22:01:15.441204 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: detected max file descriptor number: 2048 Oct 19 22:01:15.441204 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: lock engine: pthread robust mutexes Oct 19 22:01:15.441204 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: thunder lock: enabled Oct 19 22:01:15.441204 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 22:01:15.441204 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 22:01:15.482094 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: Python main interpreter initialized at 0x5617b83c49c0 Oct 19 22:01:15.482094 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: python threads support enabled Oct 19 22:01:15.482094 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: your server socket listen backlog is limited to 100 connections Oct 19 22:01:15.482094 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: your mercy for graceful operations on workers is 90 seconds Oct 19 22:01:15.482529 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 22:01:15.482529 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: *** Operational MODE: preforking *** Oct 19 22:01:15.482796 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: *** uWSGI is running in multiple interpreter mode *** Oct 19 22:01:15.482796 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: spawned uWSGI master process (pid: 121000) Oct 19 22:01:15.483036 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 19 22:01:15.483697 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: spawned uWSGI worker 1 (pid: 121021, cores: 1) Oct 19 22:01:15.484054 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: spawned uWSGI worker 2 (pid: 121022, cores: 1) Oct 19 22:01:15.484152 dv-cinder-master-3-iscsi devstack@n-api.service[121000]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 22:01:16.147137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 22:01:16.148074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 22:01:17.316678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 22:01:17.316678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: from cryptography.utils import int_from_bytes Oct 19 22:01:17.317921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 22:01:17.317921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: from cryptography.utils import int_from_bytes Oct 19 22:01:17.323849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 22:01:17.323849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: from cryptography.utils import int_from_bytes Oct 19 22:01:17.324335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 22:01:17.324335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: from cryptography.utils import int_from_bytes Oct 19 22:01:19.717964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 22:01:19.718579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 22:01:19.718781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 22:01:19.719169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 22:01:19.719428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 22:01:19.719818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.720141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.720461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.720940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.721276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.721603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.721952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.722246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.722597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.722835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.723747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.724082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.724405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.724718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.725023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.725343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.725647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.725967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.726272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.726775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.728413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.728741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.729070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.729426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.729751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.730070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.730398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.730714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.731067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.731383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.731800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.732121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.732438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.732757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.733187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.733693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.734010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.734336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.734659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.735180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.735675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.736005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.736330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.736655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.736957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.737271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.737585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.737907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.738229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.738526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.738808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.739143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.739470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.739792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.740116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.740371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.740623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.740942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.741263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.741571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.741878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.742185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.742491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.742796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.743125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.743432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.743744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.744066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.744382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.744705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.745013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.745335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.745744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.745994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.746301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.746645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.746979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.747289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.747608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.747927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.748234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.748541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.748846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.749162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.749497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.749802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.750109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.750348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.750654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.750993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.751300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.751607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.751911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.752212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.752514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.752836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.753123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.753427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.753738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.754045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.754378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.754684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.755032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.756937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.756937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.756937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.756937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.756937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.756937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.757519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.757519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.757728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.758033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.758354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.758655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.758982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.759295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.759601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.759906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.760223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.760521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.760825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.761138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.761444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.761747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.762049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.762178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 22:01:19.762649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 22:01:19.762785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.762785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.763078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 22:01:19.763214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.763359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 22:01:19.763494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.763622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 22:01:19.763755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.763888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.764013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.764150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.764285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.764442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.764574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.764748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.764921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.765067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.765258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.765401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.765576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.765707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.765931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.766069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.766221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.766359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.766553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.766693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.766829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.766996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.767152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.767295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.767547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.767688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.767875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.768015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.768182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.768318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.768491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.768634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.768810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.768940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.769117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.769246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.769425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.769571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.769733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.770387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.770572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.770776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.770938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.771100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.771235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.771414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.771554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.771727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.771868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.772067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.772199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.772419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.772541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.772734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.772882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.773059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.773199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.773368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.773503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.773673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.773811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.773984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.774121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.774345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.774488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.774658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.774798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.775004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.775139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.775320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.775462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.775629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.775769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.775938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.776149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.776280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.776416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.776573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.776720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.776887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.777020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.777197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.777339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.777516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.777656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.777828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.777968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.778149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.778280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.778458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.778582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.778759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.778873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.779921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.780053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.780181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.780314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.780449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.780583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.780583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.780835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.780835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.781081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.781214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.781341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.781479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.781616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.781744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.781877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.782004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.782140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.782267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.786477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.786477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.786780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.786913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.787083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.787214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.787341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.787476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.787593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.787714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.787831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.787940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.788052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.788160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.788266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.788396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.788506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.788612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.788719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.788826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.788938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.789057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.789164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.789279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.789393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.789501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.789605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.789720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.789827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.789940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.790054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.790161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.790349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.790475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.790591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.790591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.790828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.790828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.791162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.791281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.791409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.791535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.791669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.791669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.791915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.791915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.792166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.792166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.792410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.792542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.792679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.792811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.792944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.793077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.793203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.793203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.793455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.793455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.793708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.793834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.793967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.794106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.794247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.794383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.794510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.794641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.794768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.794892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.795044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.795179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.795316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.795442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.795574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.795706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.795851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.795985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.796118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.796118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.796369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.796517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.796727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.796865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.796990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.796990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.797220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.797350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.798014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.798152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.798288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.798414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.798538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.798675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.798822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.798996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.799150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.799277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.799415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.799548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.799680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.799805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.800178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.800303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.800441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.800567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.800699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.800831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.800957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.801088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.801281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.801410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.801536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.801670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.801804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.801931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.802057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.802183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.802308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.802446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.802574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.802707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.802834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.802986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.803134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.803269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.803395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.803528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.803663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.803663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.803910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.803910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.804272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.804272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.804511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.804636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.804775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.804910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.805042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.805168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.805301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.805435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.805570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.805696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.805820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.805946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.806070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.806205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.806339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.806465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.806589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.806737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.806944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.807129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.807265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.807394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.807534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.807673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.807800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.807935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.808078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.808607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.808747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.808883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.809019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.809155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.809283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.809411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 22:01:19.809544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.809679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.809815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.809951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.810078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.810204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.810337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.810465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.810603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.810731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.810858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.811942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.812068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.812201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.812342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.812476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.812604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.812736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.812876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.813012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.813145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.813278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.813412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.813546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.813750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.813879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.814892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.815160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.815300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.815427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.815560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.815689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.815814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.815950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.816076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.816209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.816334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.816460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.816586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.817249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.817463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.817595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.817728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.817863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.817992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.818132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.818260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.818393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.818526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.818653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.818785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.818923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.819996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.820121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.820246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.820380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.820508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.820633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.820767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.820893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.821946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.822082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.822208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.822334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.822459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.822592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.822730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.822864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.823005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.823201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.823332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.823507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.823645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.823814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.823945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.824124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.824253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.824433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.824565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.824740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.824877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.825044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.825174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.825351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.825483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.825652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.825781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.825955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.826084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.826275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.826407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.826583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.826713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.826888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.827083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.827226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.827362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.827576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.827714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.827848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.827989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.828124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.828251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.828424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.828661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.828792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.828994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.829126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.829312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.829443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.829631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.829769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.829942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.830071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.830249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.830397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.830574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.830712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.830884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.831033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.831228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.831373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.831535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.831675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.831844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.831976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.832148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.832292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.832974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.833112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.833295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.833434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.833600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.833733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.833905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.834037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.834207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.834337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.834514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.834647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.834823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.835006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.835147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.835282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.835439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.835581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.835740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.835872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.836050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.836188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.836352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.836491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.836660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.836791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.836961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.837099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.837283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.837414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.837625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.837763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.837891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.838029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.838156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.838289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.838457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.838589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.838770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.838912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.839101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.839243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.839407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.839545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.839734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.839875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.840056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.840192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.840347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.840484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.840695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.840825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.840960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.841087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.841259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.841388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.841566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.841699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.841870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.842003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.842176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.842306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.842483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.842615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.842787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.842919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.843119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.843252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.843425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.843557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.843733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.843872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.844039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.844180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.844339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.844469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.844643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.844774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.844947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.845088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.845260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.845398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.845566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.845698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.845871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.846014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.846164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.846311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.846466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.846605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.846770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.846901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.847096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.847229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.847401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.847546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.847703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.847900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.848054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.848208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.848348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.848530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.848670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.848856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.848987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.849171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.849310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.849482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.849625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.849785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.849917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.850096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.850226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.850402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.850541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.850704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.850843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.851027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.851173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.851336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.851475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.851639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.851777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.851940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.852080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.852247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.852380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.852559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.852695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.852872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.853002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.853177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.853307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.853481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.853618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.853781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.853913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.854083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.854215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.854446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.854585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.854711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.854847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.855014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.855156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.855284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.855417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.855574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.855715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.855874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.856020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.856175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.856315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.856496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.856651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.856787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.856915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.857091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.857216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.857394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.857535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.857694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.857834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.858050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.858189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.858326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.858455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.858651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.858781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.858971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.859104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.859279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.859418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.859593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.859725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.859899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.860035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.860208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.860347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.860519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.860650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.860819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.860966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.861132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.861271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.861438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.861576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.861747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.861893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.862048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.862179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.862349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.862488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.862654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.862798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.863004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.863149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.863278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.863412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.863592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.863771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.863933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.864067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.864252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.864385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.864557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.864741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.864868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.865016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.865175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.865307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.865479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.865621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.865786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.865925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.866094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.866234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.866401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.866555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.866708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.866832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.867024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.867155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.867336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.867469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.867644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.867772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.867953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.868170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.868312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.868447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.868574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.868707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.868842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.868979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.869153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.869285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.869454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.869583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.869752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.869891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.870058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.870195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.870358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.870624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.870754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.870998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.871132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.871296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.871428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.871617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.871747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.871954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.872092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.872269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.872415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.872572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.872709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.872879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.873011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.873190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.873330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.873500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.873632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.873810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.873952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.874110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.874248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.874418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.874549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.874762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.874908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.875067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.875205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.875515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.875726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.875859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.875997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.876135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.876273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.876411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.876540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.876668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.876812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.876941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.877069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.877204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.877333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.877458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.877604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.877734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.877869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.878009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.878151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.878350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.878489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.878619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.878768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.878899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.879094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.879760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.880040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.880180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.880350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.880488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.880659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.880799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.880979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.881116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.881300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.881441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.881621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.881768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.881924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.882056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.882218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.882348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.882530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.882737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.882870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.883017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.883181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.883313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.883487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.883618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.883797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.883928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.884098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.884229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.884407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.884546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.884713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.884866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.885061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.885208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.885346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.885475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.885623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.885755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.885935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.886068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.886238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.886379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.886548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.886681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.886851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.887034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.887193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.887333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.887508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.887639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.887816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.887961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.888123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.888255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.888470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.888608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.888744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.888879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.889024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.889155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.889318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.889459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.889625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.889846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.889977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.890104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.890232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.890374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.890516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.890645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.890812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.890945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.891140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.891275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.891450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.891591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.891757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.891889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.892079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.892217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.892388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.892527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.892690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.892828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.892993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.893123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.893304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.893442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.893607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.893741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.893910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.894047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.894212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.894346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.894534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.894676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.894842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.895610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.895752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.895881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.896008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.896135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.896304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.896446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.896612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.896757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.896918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.897050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.897422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.897565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.897692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.897819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.897955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.898083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.898219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.898355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.898500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.898706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.898839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.898977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.899121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.899251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.899386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.899519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.899656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.899791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.899928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.900056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.900184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.900310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.900515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.900650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.900821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.900955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.901119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.901250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.901420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.901566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.901740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.901891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.902046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.902184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.902346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.902480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.902653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.902788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.902996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.903133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.903273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.903404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.903559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.903692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.903897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.904039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.904200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.904334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.904503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.904634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.904807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.904954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.905127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.905265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.905438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.905587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.905748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.905894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.906056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.906187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.906368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.906500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.906680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.906830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.906987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.907116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.907304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.907437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.907615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.907755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.907925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.908064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.908234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.908360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.908545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.908690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.908894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.909060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.909209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.909391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.909531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.909707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.909839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.910021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.910158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.910333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.910475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.911201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.911332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.911495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.911640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.911847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.911985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.912115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.912243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.912401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.912541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.912705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.912843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.913015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.913155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.913320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.913453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.913637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.913770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.913943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.914084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.914271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.914417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.914585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.914725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.914897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.915053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.915232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.915398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.915645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.915774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.915914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.916042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.916170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.916310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.916483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.916624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.916791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.916924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.917103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.917234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.917410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.917550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.917719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.917845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.918033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.918161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.918345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.918480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.918654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.918794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.919040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.919183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.919312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.919440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.919573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.919714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.919888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.920024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.920210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.920340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.920528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.920668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.920831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.920962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.921142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.921322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.921469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.921609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.921857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.921987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.922164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.922297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.922612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.922762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.922901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.923082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.923211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.923337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.923532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.923665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.923848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.923992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.924170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.924294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.924477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.924611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.924794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.925189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.925361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.925502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.925688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.925822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.925992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.926184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.926860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.927014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.927268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.927422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.927552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.927687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.927815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.927953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.928104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.928250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.928442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.928636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.928763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.929061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.929215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.929356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.929485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.929618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.929781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.929925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.930219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.930370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.930501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.931153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.931297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.931439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.931569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.931707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.931979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.932111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.932235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.932363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.932490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.932624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.932767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.932895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.933964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.934099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.934227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.934363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.934498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.934626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.934760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.934895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.935995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.936137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.936273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.936401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.936535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.936672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.936800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.936927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.937060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.937188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.937341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.937489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.937618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.937753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.937888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.938024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.938223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.938363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.938476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.938593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.938784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.938905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.944702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.944803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.944883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.944974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.945931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.946992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.947996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.948977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.949899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.950882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.951960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.952115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.952248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.952374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.952514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.952642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.952777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.952905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.953952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.954088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.954217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.954333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.954443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.954575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.954713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.954841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.955950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.956965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.957099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.957232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.957391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.957532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.957674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.957803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.957937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.958079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.958207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.958324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.958446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.958581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.958757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.958906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.959048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.959190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.959328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.959465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.959687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.959839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.959969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.960935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.961941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.962037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.962241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.962336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.962541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.962635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.962843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.962936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.963168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.963273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.963472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.963590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.963772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.963866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.964078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.964378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.964476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.964680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.964786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.964980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.965072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.965282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.965381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.965588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.965683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.965916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.966009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.966246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.966338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.966557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.966650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.966876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.966991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.967208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.968804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.968943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.969787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.970930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.971935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.972122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.972222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.972445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.972544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.972761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.972867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.973599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.973700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.973909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.974008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.974218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.974320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.974524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.974626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.974831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.974922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.975160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.975274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.975465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.975567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.975776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.975882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.976091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.976237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.976402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.976549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.976710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.976843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.977018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.977153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.977329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.977461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.977633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.977763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.977946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.978079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.978253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.978397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.978560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.978700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.978865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.979052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.979183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.979323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.979497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.979639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.979804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.979937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.980206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.980349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.980469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.980613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.980757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.980884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.981076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.981205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.981379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.981524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.981652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 22:01:19.981778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.982006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.982704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.982704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.983010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.983259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.983584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.983899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.984217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.984566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.984886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.985423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.985758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.986079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.986413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.986807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.988471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.988471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.988471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.988471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.988471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.989658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.990469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.990469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.990728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.991204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.991695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.992017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.992467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.992787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.993106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.993424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.993765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.994080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.994405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.994756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.995103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.995425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.995745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.996064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.996377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.996689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.997004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.997311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.997626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.997959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.998276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.998649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:19.999084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.002037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.003129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.003129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.003129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.003129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.003622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.003622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.003934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.004269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.004585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.004909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.005222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.005533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.005843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.006154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.006461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.006808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.007144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.007449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.007759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.008082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.008369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.008675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.009087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.009400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.009710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.010022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.010328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.010638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.010941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.011271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.011579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.011913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.012250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.012568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.012941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.013248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.013573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.013886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.014213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.014543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.014866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.015206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.015541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.015855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.016169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.016482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.016793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.017107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.017416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.017746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.018076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.018384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.018713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.019057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.019469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.019802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.020143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.020475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.020789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.021099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.021411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.021723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.022032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.022350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.022662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.022991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.023312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.023628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.023996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.024330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.024642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.024994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.025302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.025650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.025964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.026310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.026642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.026975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.027299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.027609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 22:01:20.027854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 22:01:20.042850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO dbcounter [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Registered counter for database nova_api Oct 19 22:01:20.064029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.070801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writer thread running {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.090210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO dbcounter [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Registered counter for database nova_api Oct 19 22:01:20.110661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_db.sqlalchemy.engines [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.117925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writer thread running {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.126829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.context [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96479bbc-106d-47fa-b01e-302825761e12(cell1) {{(pid=121021) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 22:01:20.130930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:01:20.131463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:01:20.133022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:01:20.133767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:01:20.134224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:01:20.136243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:01:20.138231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO dbcounter [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Registered counter for database nova_cell0 Oct 19 22:01:20.142260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO dbcounter [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Registered counter for database nova_cell1 Oct 19 22:01:20.150033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.151785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.157248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writer thread running {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.163160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writer thread running {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.174823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.context [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96479bbc-106d-47fa-b01e-302825761e12(cell1) {{(pid=121022) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 22:01:20.179132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:01:20.179614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:01:20.181195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:01:20.181925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:01:20.182574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:01:20.184599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:01:20.186578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO dbcounter [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Registered counter for database nova_cell0 Oct 19 22:01:20.190673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO dbcounter [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Registered counter for database nova_cell1 Oct 19 22:01:20.198088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_db.sqlalchemy.engines [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.199836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_db.sqlalchemy.engines [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.205399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writer thread running {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.211279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writer thread running {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.306769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO dbcounter [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Registered counter for database nova_cell0 Oct 19 22:01:20.314995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_db.sqlalchemy.engines [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.319843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writer thread running {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.361734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO dbcounter [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Registered counter for database nova_cell0 Oct 19 22:01:20.369964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_db.sqlalchemy.engines [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 22:01:20.374720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writer thread running {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 22:01:20.650262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: WARNING keystonemiddleware.auth_token [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 22:01:20.658006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: WARNING keystonemiddleware.auth_token [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 22:01:20.699157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: WARNING keystonemiddleware.auth_token [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 22:01:20.706582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: WARNING keystonemiddleware.auth_token [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 22:01:21.008988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: WARNING keystonemiddleware.auth_token [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 22:01:21.014901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: WARNING keystonemiddleware.auth_token [None req-41ae4bb9-0ab8-4e0f-99d7-66e07752ba5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 22:01:21.020822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617b83c49c0 pid: 121021 (default app) Oct 19 22:01:21.052539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: WARNING keystonemiddleware.auth_token [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 22:01:21.058512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: WARNING keystonemiddleware.auth_token [None req-eb48d483-ba57-4da4-bf9a-a3ac71e6cbcb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 22:01:21.063935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5617b83c49c0 pid: 121022 (default app) Oct 19 22:01:58.041631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=3 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:58.043359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=3 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:58.049578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=3 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:58.049578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=3 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:58.284982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:58.286976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:58.288152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:58.289318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:01:59.435745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-95b3d917-0a83-4c49-961a-7d5e378f07dc tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Action: 'create', calling method: .version_select at 0x7f7333ddbc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-498324727"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:01:59.827944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-304ff7f3-3635-4c7f-878d-84ad1e99be6d tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Action: 'create', calling method: .version_select at 0x7f7333ddcb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-917791458", "metadata": {"Type": "work"}}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:01.594254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-95b3d917-0a83-4c49-961a-7d5e378f07dc tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.568449 Oct 19 22:02:01.594939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Oct 19 22:01:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3571 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 22:02:01.612125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-19510665-3227-46de-931a-43a4cdad061d tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333cb4a60>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:01.725098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-19510665-3227-46de-931a-43a4cdad061d tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390" status: 200 len: 344 microversion: 2.1 time: 0.117864 Oct 19 22:02:01.725915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:01 2022] GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:01.787113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-304ff7f3-3635-4c7f-878d-84ad1e99be6d tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.502324 Oct 19 22:02:01.787113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 19 22:01:58 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3505 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 19 22:02:01.800157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a66d55e2-eb5e-411e-8134-10bca206e5b6 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333c46160>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:01.904593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a66d55e2-eb5e-411e-8134-10bca206e5b6 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 200 len: 352 microversion: 2.1 time: 0.108205 Oct 19 22:02:01.905482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:01 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:02.503940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7ccb52c1-cec7-4621-867d-07e8edd1233b tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333cb79d0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:02.626891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7ccb52c1-cec7-4621-867d-07e8edd1233b tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ecd37dc4-2352-495d-8816-2d413e02bbd3" status: 200 len: 350 microversion: 2.1 time: 0.129362 Oct 19 22:02:02.627571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2/5] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:02 2022] GET /compute/v2.1/os-volumes/ecd37dc4-2352-495d-8816-2d413e02bbd3 => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:02.740863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-74250a48-12b5-435c-9d68-73a63edda0f0 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c468b0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:02.909449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-74250a48-12b5-435c-9d68-73a63edda0f0 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390" status: 200 len: 345 microversion: 2.1 time: 0.174130 Oct 19 22:02:02.918326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2365f063-c81f-4c56-8477-7284e253933d tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333c4b160>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:02.920591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:02 2022] GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 => generated 345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:02.933689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d213f0a0-a1ce-483c-a684-2bebdfc6622b tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Action: 'create', calling method: .version_select at 0x7f7333cb4b80>, body: {"snapshot": {"volume_id": "7c1f1b39-8a6e-4430-bc91-31ddf5205390", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1976270942"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:03.016739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2365f063-c81f-4c56-8477-7284e253933d tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 200 len: 353 microversion: 2.1 time: 0.102182 Oct 19 22:02:03.017702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:02 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:03.031858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1f293970-a9d1-4da8-9dae-277b96dbddc3 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333c4b820>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:03.867064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d213f0a0-a1ce-483c-a684-2bebdfc6622b tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.940916 Oct 19 22:02:03.874749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 5/8] 10.222.0.20 () {60 vars in 1162 bytes} [Wed Oct 19 22:02:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:02:03.883708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1cc41c3d-3ea1-4806-bcf1-37da05275ae9 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c46ca0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:03.884735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1f293970-a9d1-4da8-9dae-277b96dbddc3 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 200 len: 353 microversion: 2.1 time: 0.857698 Oct 19 22:02:03.885320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:03 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 353 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:02:03.900240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dbeac8ef-db94-4d43-99d0-1a70f8272532 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333cb7c10>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:04.097184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1cc41c3d-3ea1-4806-bcf1-37da05275ae9 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 200 len: 287 microversion: 2.1 time: 0.213452 Oct 19 22:02:04.097184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:03 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 287 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:04.103073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-384f93a7-0b00-4418-9efd-a78d926c6809 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c513a0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:04.191981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-384f93a7-0b00-4418-9efd-a78d926c6809 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.093157 Oct 19 22:02:04.192814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 7/11] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Oct 19 22:02:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:04.204736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-107d7606-cc9c-4599-a6c8-388939d34ff4 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c463a0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:04.263613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-107d7606-cc9c-4599-a6c8-388939d34ff4 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 200 len: 287 microversion: 2.1 time: 0.062805 Oct 19 22:02:04.264469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 8/12] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:04 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:02:04.310791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dbeac8ef-db94-4d43-99d0-1a70f8272532 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 202 len: 0 microversion: 2.1 time: 0.414178 Oct 19 22:02:04.312905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 5/13] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:02:03 2022] DELETE /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 22:02:04.320916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-70761ad1-8498-4894-9f15-c3681923148c tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333c469d0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:04.453506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-70761ad1-8498-4894-9f15-c3681923148c tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 200 len: 352 microversion: 2.1 time: 0.135226 Oct 19 22:02:04.453506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 9/14] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:04 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:05.277878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7587ff24-2c01-453a-bd31-782e0e5f3353 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c4baf0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:05.374353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7587ff24-2c01-453a-bd31-782e0e5f3353 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 200 len: 287 microversion: 2.1 time: 0.101681 Oct 19 22:02:05.376099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 6/15] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:05 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:05.472586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-47cec05a-12cd-4834-963e-179b9c0b2c3a tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333cb4af0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:05.614003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-47cec05a-12cd-4834-963e-179b9c0b2c3a tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 200 len: 352 microversion: 2.1 time: 0.148442 Oct 19 22:02:05.615428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 10/16] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:05 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:06.389246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ab561242-4928-402b-8835-97c63ffe6e83 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c4b3a0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:06.447608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ab561242-4928-402b-8835-97c63ffe6e83 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 200 len: 287 microversion: 2.1 time: 0.062857 Oct 19 22:02:06.448541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 7/17] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:06 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:06.629367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-40126ba4-7ba8-4847-90d7-9b8c59e1349d tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333cb4820>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:06.700738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-40126ba4-7ba8-4847-90d7-9b8c59e1349d tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 200 len: 352 microversion: 2.1 time: 0.072899 Oct 19 22:02:06.701398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 11/18] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:06 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:07.460838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-00a81999-5bb2-4fd2-b740-021d304d3849 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333cb78b0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:07.518988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-00a81999-5bb2-4fd2-b740-021d304d3849 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 200 len: 287 microversion: 2.1 time: 0.061904 Oct 19 22:02:07.519631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 8/19] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:07 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:07.715299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-84d8712c-e6d2-48dd-874c-5140abfa3d6a tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333c46b80>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:07.819855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-84d8712c-e6d2-48dd-874c-5140abfa3d6a tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 200 len: 352 microversion: 2.1 time: 0.108105 Oct 19 22:02:07.820348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 12/20] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:07 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:08.447351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-12038f67-f760-4556-b35e-cb2af19928ab tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333c4bca0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:08.505867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-12038f67-f760-4556-b35e-cb2af19928ab tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6f8d2f82-9640-4301-af83-11805eb9c5d4" status: 200 len: 350 microversion: 2.1 time: 0.062228 Oct 19 22:02:08.507145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 9/21] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:08 2022] GET /compute/v2.1/os-volumes/6f8d2f82-9640-4301-af83-11805eb9c5d4 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:08.532708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-13c95d20-8040-4af4-9b5f-add98bdbda96 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c46430>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:08.587890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-13c95d20-8040-4af4-9b5f-add98bdbda96 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 200 len: 288 microversion: 2.1 time: 0.059299 Oct 19 22:02:08.589896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 13/22] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:08 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 288 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:08.600610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5b4a8991-7ccd-423b-8542-4810be7e9142 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c4b790>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:08.836822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-af7c4fc8-315a-4a59-862c-73ee9242e810 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Calling method '.version_select at 0x7f7333c46dc0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:08.846840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5b4a8991-7ccd-423b-8542-4810be7e9142 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 202 len: 0 microversion: 2.1 time: 0.250478 Oct 19 22:02:08.848089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 10/23] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Oct 19 22:02:08 2022] DELETE /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:02:08.856290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e5e85246-0a85-4a18-b8b4-03ba5a84998f tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c570d0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:08.884887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-af7c4fc8-315a-4a59-862c-73ee9242e810 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] HTTP exception thrown: Volume 93503327-5016-49ec-be0c-d97d368a9d9c could not be found. Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-af7c4fc8-315a-4a59-862c-73ee9242e810 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Request method failure captured: Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c HTTP/1.1 Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPWiKIHABg7vnb4cr8gEqdcRJFZk_bgQta4sHxlphdvK0Mu9pKDxmLX_cvaJXBCU8GoUbGuZTlopzbaqtCYjTrq0evTWUr_FqC1szfj43bfZLFGmBWYoQaUkOAwuobQ7JlXLmguTlVNYyqlllxJPWDxAuMH0ughvBRKy503Bdjr7tk Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: a91947afbaac424687272654e103fd89 Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-VolumesGetTestJSON-1134949225 Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:02:08.891019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a91947afbaac424687272654e103fd89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a91947afbaac424687272654e103fd89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a91947afbaac424687272654e103fd89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a91947afbaac424687272654e103fd89"}]}] Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-VolumesGetTestJSON-1134949225 Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: a91947afbaac424687272654e103fd89 Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-VolumesGetTestJSON-1134949225 Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-VolumesGetTestJSON-1134949225-project Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 1ab8e2ac6f0e48e4aa413613238ad5bf Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-VolumesGetTestJSON-1134949225-project Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Volume 93503327-5016-49ec-be0c-d97d368a9d9c could not be found. Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '93503327-5016-49ec-be0c-d97d368a9d9c'} Oct 19 22:02:08.894128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93503327-5016-49ec-be0c-d97d368a9d9c could not be found. (HTTP 404) (Request-ID: req-1a62450d-a0be-4f15-bb98-c3e08563ba96) Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:08.896071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:08.897284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93503327-5016-49ec-be0c-d97d368a9d9c could not be found. Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 22:02:08.898380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93503327-5016-49ec-be0c-d97d368a9d9c could not be found. Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93503327-5016-49ec-be0c-d97d368a9d9c could not be found. Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-af7c4fc8-315a-4a59-862c-73ee9242e810 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] Returning 404 to user: Volume 93503327-5016-49ec-be0c-d97d368a9d9c could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-af7c4fc8-315a-4a59-862c-73ee9242e810 tempest-VolumesGetTestJSON-1134949225 tempest-VolumesGetTestJSON-1134949225-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c" status: 404 len: 109 microversion: 2.1 time: 0.062168 Oct 19 22:02:08.899842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 14/24] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:08 2022] GET /compute/v2.1/os-volumes/93503327-5016-49ec-be0c-d97d368a9d9c => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:02:08.929489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e5e85246-0a85-4a18-b8b4-03ba5a84998f tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 200 len: 287 microversion: 2.1 time: 0.077371 Oct 19 22:02:08.935392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 11/25] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:08 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:09.944957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-adc451e0-3fcf-49c4-99be-5ffd133079c5 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c51d30>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:10.029640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-adc451e0-3fcf-49c4-99be-5ffd133079c5 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] HTTP exception thrown: Snapshot 406facaf-d9d4-4f79-90c1-bc4e86ad6658 could not be found. Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-adc451e0-3fcf-49c4-99be-5ffd133079c5 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Request method failure captured: Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 HTTP/1.1 Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPVznWHrc5A9mYEOo2kHC-OVCo-L8baWPSLQaAf5PoGdgHu6RpkVyIuJhW9PAyToEPyCCREmQuUuVfVls3OCZJeiPrxBYTFDaBuXx3twMvVTIlQJh1x657gPfK_HIVJk4Yx7E9jhXhhtnt_t83hyIqee19qnMYhTRm2FslJZSqg5WU Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:02:10.032619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}] Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: e3a3c499785348d487fdbe56819aba65 Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Snapshot 406facaf-d9d4-4f79-90c1-bc4e86ad6658 could not be found. Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '406facaf-d9d4-4f79-90c1-bc4e86ad6658'} Oct 19 22:02:10.034095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 406facaf-d9d4-4f79-90c1-bc4e86ad6658 could not be found. (HTTP 404) (Request-ID: req-8fb5c5eb-10e7-48b4-90e7-ee9213cba006) Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:10.035165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:10.036603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 406facaf-d9d4-4f79-90c1-bc4e86ad6658 could not be found. Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 19 22:02:10.038666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 406facaf-d9d4-4f79-90c1-bc4e86ad6658 could not be found. Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 406facaf-d9d4-4f79-90c1-bc4e86ad6658 could not be found. Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-adc451e0-3fcf-49c4-99be-5ffd133079c5 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Returning 404 to user: Snapshot 406facaf-d9d4-4f79-90c1-bc4e86ad6658 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:10.042904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-adc451e0-3fcf-49c4-99be-5ffd133079c5 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658" status: 404 len: 111 microversion: 2.1 time: 0.101394 Oct 19 22:02:10.052830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 15/26] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Oct 19 22:02:09 2022] GET /compute/v2.1/os-snapshots/406facaf-d9d4-4f79-90c1-bc4e86ad6658 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:02:10.058115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6efcaf6b-29fa-41f4-824b-57b27268cf23 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c4b8b0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:10.403470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6efcaf6b-29fa-41f4-824b-57b27268cf23 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390" status: 202 len: 0 microversion: 2.1 time: 0.348769 Oct 19 22:02:10.405442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 12/27] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:02:10 2022] DELETE /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:02:10.421880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1458bc4e-af27-4379-b3e4-617ac9021a7e tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c51f70>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:10.589812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3be5123b-ccd4-4116-ac5d-eed04b417f44 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333c4b0d0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:10.594187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1458bc4e-af27-4379-b3e4-617ac9021a7e tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390" status: 200 len: 344 microversion: 2.1 time: 0.180698 Oct 19 22:02:10.595008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 16/28] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:10 2022] GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:10.673032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3be5123b-ccd4-4116-ac5d-eed04b417f44 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/9942d64b-fef7-4d36-b9c6-074bf0ad3b71" status: 200 len: 350 microversion: 2.1 time: 0.087154 Oct 19 22:02:10.674074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 13/29] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:10 2022] GET /compute/v2.1/os-volumes/9942d64b-fef7-4d36-b9c6-074bf0ad3b71 => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:10.691968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3b05ec4d-1d1a-4f1b-9dba-ce61a6cae7f2 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333c51280>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:10.951627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3b05ec4d-1d1a-4f1b-9dba-ce61a6cae7f2 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.235961 Oct 19 22:02:10.951627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Oct 19 22:02:10 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:10.965334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2d6b97b-3a51-4ee2-b7f2-e1b0eb4f83ba tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333cb7dc0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:11.236807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2d6b97b-3a51-4ee2-b7f2-e1b0eb4f83ba tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.210472 Oct 19 22:02:11.236807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 14/31] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Oct 19 22:02:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:11.260347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b09a51c1-5972-4d25-8193-142aba1ec069 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333bbde50>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:11.460631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b09a51c1-5972-4d25-8193-142aba1ec069 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.210268 Oct 19 22:02:11.463479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 18/32] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Oct 19 22:02:11 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:11.481054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09488de3-b27e-4f2b-8e02-6dd528ddecde tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333cb79d0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:11.750586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09488de3-b27e-4f2b-8e02-6dd528ddecde tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.275405 Oct 19 22:02:11.760493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 15/33] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Oct 19 22:02:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:11.760493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e49d68e5-5bf3-4024-9b70-6944ae868b0f tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333c4be50>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:11.845544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-e49d68e5-5bf3-4024-9b70-6944ae868b0f tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] HTTP exception thrown: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e49d68e5-5bf3-4024-9b70-6944ae868b0f tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Request method failure captured: Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 HTTP/1.1 Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPVznWHrc5A9mYEOo2kHC-OVCo-L8baWPSLQaAf5PoGdgHu6RpkVyIuJhW9PAyToEPyCCREmQuUuVfVls3OCZJeiPrxBYTFDaBuXx3twMvVTIlQJh1x657gPfK_HIVJk4Yx7E9jhXhhtnt_t83hyIqee19qnMYhTRm2FslJZSqg5WU Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:02:11.846703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}] Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: e3a3c499785348d487fdbe56819aba65 Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '7c1f1b39-8a6e-4430-bc91-31ddf5205390'} Oct 19 22:02:11.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. (HTTP 404) (Request-ID: req-053665b4-6010-4785-a6d8-209714471fb4) Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:11.849667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:11.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 22:02:11.863884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e49d68e5-5bf3-4024-9b70-6944ae868b0f tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Returning 404 to user: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e49d68e5-5bf3-4024-9b70-6944ae868b0f tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390" status: 404 len: 109 microversion: 2.1 time: 0.100498 Oct 19 22:02:11.866366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 16/34] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:11 2022] GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:02:11.868162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-143c419e-2b81-434e-9deb-4a620aaff912 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333c57550>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:11.868266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-40ed4f2d-8385-452b-acff-7ce021b54742 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'create', calling method: .version_select at 0x7f7333bbd310>, body: {"keypair": {"name": "tempest-keypair-1379585045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtWx2EYi60s+aHfC/XCBQAtWCqKaUKP3wf1UrxUeuOTWtjB6PXS7Z64MRjiCPSXus96GdW7HzZyWGtAgIYgBm7EBq2XNHK6vtNJ2O3hG6BZHhC7Cur5CzaoBAhYCJI5XA=="}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:11.995593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-40ed4f2d-8385-452b-acff-7ce021b54742 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for project 88309b84283a4052aa1d957047390cb8. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:02:12.028963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-40ed4f2d-8385-452b-acff-7ce021b54742 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for user f9b4be7642f3441ab83cf81e1029e017 and project 88309b84283a4052aa1d957047390cb8. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:02:12.059811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-143c419e-2b81-434e-9deb-4a620aaff912 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.205631 Oct 19 22:02:12.060539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Oct 19 22:02:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:12.070581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e3f4fb7-140e-471a-b63f-18f5d0ba15b4 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333bc3790>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:12.124937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-4e3f4fb7-140e-471a-b63f-18f5d0ba15b4 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] HTTP exception thrown: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e3f4fb7-140e-471a-b63f-18f5d0ba15b4 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Request method failure captured: Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: DELETE /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 HTTP/1.1 Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPVznWHrc5A9mYEOo2kHC-OVCo-L8baWPSLQaAf5PoGdgHu6RpkVyIuJhW9PAyToEPyCCREmQuUuVfVls3OCZJeiPrxBYTFDaBuXx3twMvVTIlQJh1x657gPfK_HIVJk4Yx7E9jhXhhtnt_t83hyIqee19qnMYhTRm2FslJZSqg5WU Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:02:12.127382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}] Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: e3a3c499785348d487fdbe56819aba65 Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '7c1f1b39-8a6e-4430-bc91-31ddf5205390'} Oct 19 22:02:12.128646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. (HTTP 404) (Request-ID: req-ec626206-b10f-4f34-8186-a8eed3ed7e10) Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:12.129392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 22:02:12.131109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 22:02:12.132220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.133295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.135691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e3f4fb7-140e-471a-b63f-18f5d0ba15b4 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Returning 404 to user: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:12.136739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4e3f4fb7-140e-471a-b63f-18f5d0ba15b4 tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390" status: 404 len: 109 microversion: 2.1 time: 0.075192 Oct 19 22:02:12.137476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 18/36] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:02:12 2022] DELETE /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:02:12.142990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-db00d91a-ad2f-4691-b5ec-a0bacc781ed8 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333c57430>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:12.282168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-40ed4f2d-8385-452b-acff-7ce021b54742 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.745427 Oct 19 22:02:12.283128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 19/37] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 19 22:02:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 747 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 19 22:02:12.294333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b37bc5fd-abf8-4344-b11f-0052860cf45c tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Calling method '.version_select at 0x7f7333bb18b0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:12.335056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-db00d91a-ad2f-4691-b5ec-a0bacc781ed8 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.196337 Oct 19 22:02:12.344593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 19 22:02:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:12.350064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-20231a86-705a-4f2b-a61c-ba13d9748796 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333bc3d30>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:12.387753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-b37bc5fd-abf8-4344-b11f-0052860cf45c tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] HTTP exception thrown: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b37bc5fd-abf8-4344-b11f-0052860cf45c tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Request method failure captured: Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 HTTP/1.1 Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPVznWHrc5A9mYEOo2kHC-OVCo-L8baWPSLQaAf5PoGdgHu6RpkVyIuJhW9PAyToEPyCCREmQuUuVfVls3OCZJeiPrxBYTFDaBuXx3twMvVTIlQJh1x657gPfK_HIVJk4Yx7E9jhXhhtnt_t83hyIqee19qnMYhTRm2FslJZSqg5WU Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:02:12.390233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d7c346beac34a4aae8b3be8e5489f88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d7c346beac34a4aae8b3be8e5489f88"}]}] Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 9d7c346beac34a4aae8b3be8e5489f88 Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941181882 Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: e3a3c499785348d487fdbe56819aba65 Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941181882-project Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '7c1f1b39-8a6e-4430-bc91-31ddf5205390'} Oct 19 22:02:12.391562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. (HTTP 404) (Request-ID: req-07693c38-274e-454e-95bd-5105e6dad734) Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:12.392309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:12.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 22:02:12.394461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b37bc5fd-abf8-4344-b11f-0052860cf45c tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] Returning 404 to user: Volume 7c1f1b39-8a6e-4430-bc91-31ddf5205390 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b37bc5fd-abf8-4344-b11f-0052860cf45c tempest-VolumesSnapshotsTestJSON-941181882 tempest-VolumesSnapshotsTestJSON-941181882-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390" status: 404 len: 109 microversion: 2.1 time: 0.107594 Oct 19 22:02:12.395675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:12 2022] GET /compute/v2.1/os-volumes/7c1f1b39-8a6e-4430-bc91-31ddf5205390 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:02:12.527975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-20231a86-705a-4f2b-a61c-ba13d9748796 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.181370 Oct 19 22:02:12.540945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Oct 19 22:02:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:12.545824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-afdf330c-94d4-4c30-adb8-53004e958892 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] Calling method '.version_select at 0x7f7333bb19d0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:12.733956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-afdf330c-94d4-4c30-adb8-53004e958892 tempest-VolumesTestJSON-1341098770 tempest-VolumesTestJSON-1341098770-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.184456 Oct 19 22:02:12.733956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Oct 19 22:02:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:15.461784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2055533-7728-4477-9737-40a5d8f73a2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: .version_select at 0x7f7333c57820>, body: {"keypair": {"name": "tempest-keypair-465514843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSZJcguu9bG7UGtOgPtBieXDwTesvplbpmRBpNBanMTt5BCFtQtUQPHlH78ScRWQNq1/7CGmq+umOMCd2am295Yw20+P/UzBG7MxSLW+0ovJAWZf8+ez1NCQnEBKrUe7A=="}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:15.604119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a2055533-7728-4477-9737-40a5d8f73a2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:02:15.630280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a2055533-7728-4477-9737-40a5d8f73a2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:02:15.797514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2055533-7728-4477-9737-40a5d8f73a2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.145389 Oct 19 22:02:15.799690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:02:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:16.506457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1880283538", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "networks": [{"uuid": "993b1e93-c653-4dcb-8973-7a65011cadd6"}]}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:16.646325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-714707290", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:16.736071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] validate_networks() for [('993b1e93-c653-4dcb-8973-7a65011cadd6', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:02:16.840396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] validate_networks() for [('d2879824-dc50-40d2-9504-357f60cd02db', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:02:19.207444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:02:19.207999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:02:19.209270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:02:19.209270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:02:19.209636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:02:19.227534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:19.228071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:19.228506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:19.232198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:19.232958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:19.233415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:19.287428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Getting quotas for project 95e2ff128466409e98277d6e1c620fca. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:02:19.295114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Getting quotas for user 53639656d3a542c0b822ea8084b2e2d5 and project 95e2ff128466409e98277d6e1c620fca. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:02:19.318107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:02:19.321595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:02:19.482850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f1191468-1d9d-4426-b32f-a489ad496c9b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.431048 Oct 19 22:02:19.484157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:02:19.675872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:02:19.676877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:02:19.677355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:02:19.678019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:02:19.678211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:02:19.693505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:19.694345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:19.695118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:19.696409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:19.697031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:19.697643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:19.762454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for project 65cb45d314f743799145a0fc614ce83e. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:02:19.767997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for user 2c7d8acfab1041fc8edf36fd42b06993 and project 65cb45d314f743799145a0fc614ce83e. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:02:19.796819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:02:19.801926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:02:19.936469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b352a8f9-6440-4cd8-8f2f-b9dbbf4f39e2 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Action: 'create', calling method: .version_select at 0x7f7333af3430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1854349155", "metadata": {"Type": "work"}}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b352a8f9-6440-4cd8-8f2f-b9dbbf4f39e2 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Request method failure captured: Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 122 Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPogvk3eRWNGjrVrvRdQ999iAmi2naJubdgQWDxcDbe-uSOp2fkPFqaErhIyTpm-cTAowbI9bIHWcB4h_zck-ThOREOwg9ppFGIfKTmJcjcYo1EsPcrtBHK131FWldKWScekjrtzb01Dmjp9bMLpc6wFXFOF-v8hpaDVzqtBmAR07Q Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:02:19.950841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}] Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 7685537bc1a545628845560fe7b40f51 Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1854349155", "metadata": {"Type": "work"}}} Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: Oct 19 22:02:19.960256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1854349155', 'metadata': {'Type': 'work'}}}} Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise error Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi '#$%' Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:19.960936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 22:02:19.961933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 22:02:19.962879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 22:02:19.962879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:02:19.962879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b352a8f9-6440-4cd8-8f2f-b9dbbf4f39e2 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:19.962879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b352a8f9-6440-4cd8-8f2f-b9dbbf4f39e2 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.466272 Oct 19 22:02:19.962879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 19 22:02:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 468 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:02:19.974210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-509027169", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15dc36a9-e59a-4cc5-b4c0-b0231775f689"}], "security_groups": [{"name": "tempest-securitygroup--1143705453"}], "key_name": "tempest-keypair-1379585045", "user_data": "}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:20.028586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fb6fbc68-7314-46d6-bf43-8ad3bd89f21b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.785818 Oct 19 22:02:20.029843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:02:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:02:20.038993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4330cdba-f871-48ee-a065-ae26e5af796c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:20.040078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4330cdba-f871-48ee-a065-ae26e5af796c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:20.198614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4330cdba-f871-48ee-a065-ae26e5af796c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:20.245617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4330cdba-f871-48ee-a065-ae26e5af796c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1215 microversion: 2.1 time: 0.208337 Oct 19 22:02:20.247688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 23/46] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:20 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:20.256548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] validate_networks() for [('15dc36a9-e59a-4cc5-b4c0-b0231775f689', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:02:20.278996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d934144-3f33-411e-8f27-03c7f01e487b tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Action: 'create', calling method: .version_select at 0x7f7333287dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1935317754", "metadata": {"Type": "work"}}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d934144-3f33-411e-8f27-03c7f01e487b tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Request method failure captured: Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 120 Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPogvk3eRWNGjrVrvRdQ999iAmi2naJubdgQWDxcDbe-uSOp2fkPFqaErhIyTpm-cTAowbI9bIHWcB4h_zck-ThOREOwg9ppFGIfKTmJcjcYo1EsPcrtBHK131FWldKWScekjrtzb01Dmjp9bMLpc6wFXFOF-v8hpaDVzqtBmAR07Q Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:02:20.289615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}] Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 7685537bc1a545628845560fe7b40f51 Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1935317754", "metadata": {"Type": "work"}}} Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: Oct 19 22:02:20.290697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1935317754', 'metadata': {'Type': 'work'}}}} Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise error Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi '0' Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:20.291573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 22:02:20.293350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 22:02:20.294432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 22:02:20.294432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.294432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d934144-3f33-411e-8f27-03c7f01e487b tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:20.306498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3d934144-3f33-411e-8f27-03c7f01e487b tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020387 Oct 19 22:02:20.307512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 19 22:02:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:02:20.324144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-17fde9d3-bc93-4251-9d41-59eaea73819a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:20.327827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-17fde9d3-bc93-4251-9d41-59eaea73819a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:20.527703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-17fde9d3-bc93-4251-9d41-59eaea73819a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:20.527703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-17fde9d3-bc93-4251-9d41-59eaea73819a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1221 microversion: 2.1 time: 0.163382 Oct 19 22:02:20.527703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:20 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1221 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:20.527703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e89e8e2f-6ea4-4a84-9b77-8b9392991ece tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Action: 'create', calling method: .version_select at 0x7f73332a8b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-816833967", "metadata": {"Type": "work"}}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e89e8e2f-6ea4-4a84-9b77-8b9392991ece tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Request method failure captured: Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 118 Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPogvk3eRWNGjrVrvRdQ999iAmi2naJubdgQWDxcDbe-uSOp2fkPFqaErhIyTpm-cTAowbI9bIHWcB4h_zck-ThOREOwg9ppFGIfKTmJcjcYo1EsPcrtBHK131FWldKWScekjrtzb01Dmjp9bMLpc6wFXFOF-v8hpaDVzqtBmAR07Q Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:02:20.529379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}] Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 7685537bc1a545628845560fe7b40f51 Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-816833967", "metadata": {"Type": "work"}}} Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: Oct 19 22:02:20.531070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-816833967', 'metadata': {'Type': 'work'}}}} Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise error Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi '' Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:20.532009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 22:02:20.533362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 22:02:20.534534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 22:02:20.534534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.534534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e89e8e2f-6ea4-4a84-9b77-8b9392991ece tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:20.534534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e89e8e2f-6ea4-4a84-9b77-8b9392991ece tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008660 Oct 19 22:02:20.534534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 26/49] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Oct 19 22:02:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:02:20.544346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f8efbac4-1715-4070-b8da-665dfcce7614 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Calling method '.version_select at 0x7f7333249160>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-f8efbac4-1715-4070-b8da-665dfcce7614 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] HTTP exception thrown: Volume tempest-invalid-1687677406 could not be found. Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f8efbac4-1715-4070-b8da-665dfcce7614 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Request method failure captured: Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1687677406 HTTP/1.1 Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPogvk3eRWNGjrVrvRdQ999iAmi2naJubdgQWDxcDbe-uSOp2fkPFqaErhIyTpm-cTAowbI9bIHWcB4h_zck-ThOREOwg9ppFGIfKTmJcjcYo1EsPcrtBHK131FWldKWScekjrtzb01Dmjp9bMLpc6wFXFOF-v8hpaDVzqtBmAR07Q Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:02:20.583372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}] Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 7685537bc1a545628845560fe7b40f51 Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Volume tempest-invalid-1687677406 could not be found. Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': 'tempest-invalid-1687677406'} Oct 19 22:02:20.584467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1687677406 could not be found. (HTTP 404) (Request-ID: req-67bb8b59-79a8-4694-a8c5-e57f9a68a5b9) Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.585094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 22:02:20.586074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1687677406 could not be found. Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:20.586999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1687677406 could not be found. Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1687677406 could not be found. Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f8efbac4-1715-4070-b8da-665dfcce7614 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Returning 404 to user: Volume tempest-invalid-1687677406 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f8efbac4-1715-4070-b8da-665dfcce7614 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1687677406" status: 404 len: 99 microversion: 2.1 time: 0.039585 Oct 19 22:02:20.587950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 27/50] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 19 22:02:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1687677406 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 22:02:20.592445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d5deb619-4cd7-426b-83be-e7b5fb5f15c7 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005126 Oct 19 22:02:20.593069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 28/51] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Oct 19 22:02:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 22:02:20.601881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-defc16f3-6e20-4915-a28d-6e4a67e3bdfb tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004013 Oct 19 22:02:20.606196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Oct 19 22:02:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 19 22:02:20.610547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8819a74b-ecd6-4db3-8b62-16b731909e30 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Calling method '.version_select at 0x7f73332a8430>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:20.690907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-8819a74b-ecd6-4db3-8b62-16b731909e30 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] HTTP exception thrown: Volume 0522f755-5705-49a5-8833-0c3d44f87c1e could not be found. Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8819a74b-ecd6-4db3-8b62-16b731909e30 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Request method failure captured: Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: DELETE /compute/v2.1/os-volumes/0522f755-5705-49a5-8833-0c3d44f87c1e HTTP/1.1 Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPogvk3eRWNGjrVrvRdQ999iAmi2naJubdgQWDxcDbe-uSOp2fkPFqaErhIyTpm-cTAowbI9bIHWcB4h_zck-ThOREOwg9ppFGIfKTmJcjcYo1EsPcrtBHK131FWldKWScekjrtzb01Dmjp9bMLpc6wFXFOF-v8hpaDVzqtBmAR07Q Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:02:20.693204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}] Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 7685537bc1a545628845560fe7b40f51 Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Volume 0522f755-5705-49a5-8833-0c3d44f87c1e could not be found. Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '0522f755-5705-49a5-8833-0c3d44f87c1e'} Oct 19 22:02:20.694319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0522f755-5705-49a5-8833-0c3d44f87c1e could not be found. (HTTP 404) (Request-ID: req-57125cf9-d8b5-46e2-be74-d019d0da3b7b) Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.695000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 22:02:20.695949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0522f755-5705-49a5-8833-0c3d44f87c1e could not be found. Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 22:02:20.696921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0522f755-5705-49a5-8833-0c3d44f87c1e could not be found. Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0522f755-5705-49a5-8833-0c3d44f87c1e could not be found. Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8819a74b-ecd6-4db3-8b62-16b731909e30 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Returning 404 to user: Volume 0522f755-5705-49a5-8833-0c3d44f87c1e could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8819a74b-ecd6-4db3-8b62-16b731909e30 tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/0522f755-5705-49a5-8833-0c3d44f87c1e" status: 404 len: 109 microversion: 2.1 time: 0.087502 Oct 19 22:02:20.697837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 30/53] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:02:20 2022] DELETE /compute/v2.1/os-volumes/0522f755-5705-49a5-8833-0c3d44f87c1e => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:02:20.705378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bd3992d-dd46-4385-a51e-60e51bb306ac tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Calling method '.version_select at 0x7f7333295820>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:20.738679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-4bd3992d-dd46-4385-a51e-60e51bb306ac tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] HTTP exception thrown: Volume 617a9712-3ffd-4cf5-a7de-ddbb104000c6 could not be found. Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bd3992d-dd46-4385-a51e-60e51bb306ac tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Request method failure captured: Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/os-volumes/617a9712-3ffd-4cf5-a7de-ddbb104000c6 HTTP/1.1 Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPogvk3eRWNGjrVrvRdQ999iAmi2naJubdgQWDxcDbe-uSOp2fkPFqaErhIyTpm-cTAowbI9bIHWcB4h_zck-ThOREOwg9ppFGIfKTmJcjcYo1EsPcrtBHK131FWldKWScekjrtzb01Dmjp9bMLpc6wFXFOF-v8hpaDVzqtBmAR07Q Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:02:20.741759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_208d603b98d04e729e6e93d5ae794aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/208d603b98d04e729e6e93d5ae794aea"}]}] Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 208d603b98d04e729e6e93d5ae794aea Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesNegativeTest-417677966 Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 7685537bc1a545628845560fe7b40f51 Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesNegativeTest-417677966-project Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Volume 617a9712-3ffd-4cf5-a7de-ddbb104000c6 could not be found. Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '617a9712-3ffd-4cf5-a7de-ddbb104000c6'} Oct 19 22:02:20.742888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 617a9712-3ffd-4cf5-a7de-ddbb104000c6 could not be found. (HTTP 404) (Request-ID: req-16c1b4d3-8dfe-45e0-be78-bf69b0fc9b7e) Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.743563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 22:02:20.753144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 617a9712-3ffd-4cf5-a7de-ddbb104000c6 could not be found. Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 22:02:20.754135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 617a9712-3ffd-4cf5-a7de-ddbb104000c6 could not be found. Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 617a9712-3ffd-4cf5-a7de-ddbb104000c6 could not be found. Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bd3992d-dd46-4385-a51e-60e51bb306ac tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] Returning 404 to user: Volume 617a9712-3ffd-4cf5-a7de-ddbb104000c6 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4bd3992d-dd46-4385-a51e-60e51bb306ac tempest-VolumesNegativeTest-417677966 tempest-VolumesNegativeTest-417677966-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/617a9712-3ffd-4cf5-a7de-ddbb104000c6" status: 404 len: 109 microversion: 2.1 time: 0.042646 Oct 19 22:02:20.755166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 31/54] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Oct 19 22:02:20 2022] GET /compute/v2.1/os-volumes/617a9712-3ffd-4cf5-a7de-ddbb104000c6 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 22:02:20.784519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1812118168", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:20.866891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] validate_networks() for [('d2879824-dc50-40d2-9504-357f60cd02db', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:02:20.877264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:02:20.879892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:02:20.881797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:02:20.882426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:02:20.883028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:02:20.896982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:20.905335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:20.905809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:20.906684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:20.907247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:20.907749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:20.933894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for project 88309b84283a4052aa1d957047390cb8. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:02:20.945328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for user f9b4be7642f3441ab83cf81e1029e017 and project 88309b84283a4052aa1d957047390cb8. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:02:20.987417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:02:20.991870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:02:21.255277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e8223cb-5352-4d15-95d0-ad969c055423 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.300624 Oct 19 22:02:21.255943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 24/55] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 19 22:02:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 22:02:21.270034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fbe9e20a-4e8f-407d-929b-d2ec7d0388f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:21.273729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fbe9e20a-4e8f-407d-929b-d2ec7d0388f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:21.482205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fbe9e20a-4e8f-407d-929b-d2ec7d0388f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:21.538619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fbe9e20a-4e8f-407d-929b-d2ec7d0388f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:21.538619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fbe9e20a-4e8f-407d-929b-d2ec7d0388f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:21.538619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fbe9e20a-4e8f-407d-929b-d2ec7d0388f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1281 microversion: 2.20 time: 0.255600 Oct 19 22:02:21.538893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 25/56] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:21.538893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e92d74b-1003-4ff8-895f-de252db5ef30 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:21.538893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e92d74b-1003-4ff8-895f-de252db5ef30 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:21.663179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e92d74b-1003-4ff8-895f-de252db5ef30 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:21.673189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e92d74b-1003-4ff8-895f-de252db5ef30 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1215 microversion: 2.1 time: 0.143972 Oct 19 22:02:21.681475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 26/57] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:21 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:21.803022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:02:21.810827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:02:21.810827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:02:21.810827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:02:21.810827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:02:21.829348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-857065328", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a761516-5fa0-488a-a25d-116b70e5b05e"}], "security_groups": [{"name": "tempest-securitygroup--534804251"}], "key_name": "tempest-keypair-465514843", "user_data": "}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:21.831023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:21.833495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:21.834248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:21.845169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:21.845169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:21.845169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:21.860041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for project 65cb45d314f743799145a0fc614ce83e. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:02:21.880320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for user 2c7d8acfab1041fc8edf36fd42b06993 and project 65cb45d314f743799145a0fc614ce83e. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:02:21.928721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:02:21.942934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:02:22.052627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] validate_networks() for [('4a761516-5fa0-488a-a25d-116b70e5b05e', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:02:22.131181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c101df1a-46e8-4915-a446-59a724c1908b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.346584 Oct 19 22:02:22.137626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 32/58] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:02:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:02:22.146304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d7ba2293-f202-4696-8121-aec49585307f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:22.147582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d7ba2293-f202-4696-8121-aec49585307f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:22.253046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d7ba2293-f202-4696-8121-aec49585307f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:22.265156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d7ba2293-f202-4696-8121-aec49585307f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1222 microversion: 2.1 time: 0.125443 Oct 19 22:02:22.266357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 33/59] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:22 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:22.555039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-23e30d08-98d0-4f2c-8fe1-e64b39cc7045 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:22.555740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-23e30d08-98d0-4f2c-8fe1-e64b39cc7045 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:22.727217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-23e30d08-98d0-4f2c-8fe1-e64b39cc7045 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:22.741469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-23e30d08-98d0-4f2c-8fe1-e64b39cc7045 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:22.746535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-23e30d08-98d0-4f2c-8fe1-e64b39cc7045 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:22.751494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-23e30d08-98d0-4f2c-8fe1-e64b39cc7045 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1281 microversion: 2.20 time: 0.201823 Oct 19 22:02:22.790309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 34/60] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:02:22.808900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:22.812476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:22.868580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:22.869933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:22.873199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:22.875595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:22.877746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:22.878438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:22.951576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:02:22.952159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:02:22.952458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:02:22.952867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:02:22.953419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:02:22.970069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:22.971928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:22.972722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:22.975385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:22.976550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:22.979099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:23.031401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:02:23.039739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:02:23.054327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:02:23.057561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:02:23.147300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:23.169531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9797b30-0078-4a5d-880a-bd0ccaa762ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1219 microversion: 2.1 time: 0.380089 Oct 19 22:02:23.171772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 35/61] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:22 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1219 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:23.260074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-48d9763e-7819-4398-9f0e-63164f99e55e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.434583 Oct 19 22:02:23.269366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 27/62] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:02:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:02:23.273755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5aa392f0-aa5d-4a9a-9fdd-784bf55985e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:23.274369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5aa392f0-aa5d-4a9a-9fdd-784bf55985e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:23.301517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-311d472d-d53f-4195-a40b-a61166ee539a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:23.306917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-311d472d-d53f-4195-a40b-a61166ee539a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:23.407701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5aa392f0-aa5d-4a9a-9fdd-784bf55985e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:23.436861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5aa392f0-aa5d-4a9a-9fdd-784bf55985e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1240 microversion: 2.1 time: 0.168074 Oct 19 22:02:23.441810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 36/63] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1240 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:23.613266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-311d472d-d53f-4195-a40b-a61166ee539a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:23.640375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-311d472d-d53f-4195-a40b-a61166ee539a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1222 microversion: 2.1 time: 0.348211 Oct 19 22:02:23.654981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 28/64] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:23 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:23.783216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:23.784191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:23.798182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:23.799654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:23.802892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:23.803881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:23.804574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:23.811444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:23.951901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:23.963467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:23.971351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:23.971351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2a3487c7-7eb3-4f50-94de-9d0a4ac13da4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1277 microversion: 2.20 time: 0.187951 Oct 19 22:02:23.971351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 37/65] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:24.197330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:24.197954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:24.208554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:24.209642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:24.210640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:24.211969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:24.212601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:24.213367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:24.398035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:24.421410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2ee6766c-d481-4b67-ad74-fadb32ca5150 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1267 microversion: 2.1 time: 0.232938 Oct 19 22:02:24.422006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 29/66] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:24 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:24.464344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3fb0c67f-8b10-49f4-8f09-1f5350c4574c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:24.464970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3fb0c67f-8b10-49f4-8f09-1f5350c4574c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:24.566073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3fb0c67f-8b10-49f4-8f09-1f5350c4574c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:24.577949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3fb0c67f-8b10-49f4-8f09-1f5350c4574c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1240 microversion: 2.1 time: 0.115016 Oct 19 22:02:24.578572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 38/67] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:24.665508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:24.667194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:24.673672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:24.674436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:24.675183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:24.676122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:24.677324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:24.677955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:24.818028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:24.827515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-63220604-bf2c-4a9a-b9db-2417ff4b4d7e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1218 microversion: 2.1 time: 0.164121 Oct 19 22:02:24.828743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 30/68] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:24 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:25.001490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:25.006490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:25.017140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.017988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.018577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:25.019481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.020836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.021421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:25.132758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:25.147731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:25.149425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:25.159210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3fe65caf-b0ae-4584-b88a-5379c897844d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1277 microversion: 2.20 time: 0.160905 Oct 19 22:02:25.183809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 39/69] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:25.445672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:25.446290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:25.462472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.464464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.464464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:25.464464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.464731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.464993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:25.601260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:25.602421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:25.616020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:25.625163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.625163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.625163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:25.625163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.629003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7090e96b-dc9b-4556-82c2-25a98c9fe3a8 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1285 microversion: 2.1 time: 0.187791 Oct 19 22:02:25.631480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.632013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:25.632196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 31/70] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:25 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:25.803064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:25.829750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f14c3b35-7368-4bc8-91b9-2fe6a106f592 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1236 microversion: 2.1 time: 0.232393 Oct 19 22:02:25.832252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 40/71] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1236 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:25.854624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:25.855277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:25.864675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.865179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.865619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:25.868721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:25.871905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:25.872472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:26.064904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:26.085743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-87d7dbd8-5f57-4667-87c5-4c725ee39ea1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1218 microversion: 2.1 time: 0.229478 Oct 19 22:02:26.089082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 32/72] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:25 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:26.210026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:26.211304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:26.231187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:26.234920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:26.235914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:26.236937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:26.237771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:26.239312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:26.483721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:26.515578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:26.517397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:26.518730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c6004503-b74c-4990-935a-b35ff9691ac3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1333 microversion: 2.20 time: 0.313739 Oct 19 22:02:26.519777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 41/73] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1333 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:26.659669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:26.663505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:26.669070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:26.670207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:26.670937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:26.672159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:26.672820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:26.673443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:26.809505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:26.833410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ecf1df0e-0dc8-4f49-8119-82a8463ad530 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1273 microversion: 2.1 time: 0.166254 Oct 19 22:02:26.833410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 33/74] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:26 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:26.869280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:26.884689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:26.913776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:26.915892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:26.917285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:26.919958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:26.921223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:26.924105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:27.110365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:27.111210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:27.121973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:27.123532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:27.125609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:27.126584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:27.131421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:27.131979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:27.434233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:27.444980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-da61eb42-8e32-4bba-9c04-5725da1bd21b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1236 microversion: 2.1 time: 0.590987 Oct 19 22:02:27.446720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 42/75] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1236 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:27.462143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:27.477731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac895eaf-dd43-4907-ba85-84b5e12dcc70 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1274 microversion: 2.1 time: 0.367375 Oct 19 22:02:27.477731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 34/76] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:27 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1274 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:27.545719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:27.550568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:27.579665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:27.604771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:27.604771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:27.604771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:27.604771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:27.605282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:27.845151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:27.847345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:27.852304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:27.852796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:27.857249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:27.859809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:27.868350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:27.878799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:27.885441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:27.898635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:27.916383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:27.916383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a3cfe574-8787-4b1b-bada-be6c4779583c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1341 microversion: 2.20 time: 0.363100 Oct 19 22:02:27.916383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 43/77] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1341 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:28.481160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:28.481160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:28.507087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:28.509658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:28.509658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:28.509658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:28.509658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:28.509985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:28.678702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:28.686723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-db81c9f1-324f-4ec9-b991-534e950fa227 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.846505 Oct 19 22:02:28.709467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 35/78] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:27 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:28.719385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:28.719385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:28.735447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:28.735936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:28.740985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:28.742861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:28.743780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:28.744214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:28.804077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:28.860481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9798aaef-943c-48df-a9d2-86e63709bd93 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1236 microversion: 2.1 time: 0.389357 Oct 19 22:02:28.877139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 44/79] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1236 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:28.954771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:28.955588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:28.966098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:28.991812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e5e634b0-30ac-4472-bf28-88e58344e694 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1282 microversion: 2.1 time: 0.281054 Oct 19 22:02:28.995598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:28.998784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:28.998784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:29.004136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:29.005929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:29.006423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:29.024164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 36/80] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:28 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1282 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:29.264269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:29.294894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:29.294894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:29.295989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0c776415-ffc4-4394-b10d-3e81e2a81c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1339 microversion: 2.20 time: 0.354770 Oct 19 22:02:29.300184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 45/81] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:29.716219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:29.719389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:29.798581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:29.833705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:29.833705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:29.833705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:29.833705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:29.833997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:29.885444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:29.886792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:29.905115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:29.905611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:29.910668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:29.921197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:29.943023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:29.943023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:30.247952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:30.262029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-90e96885-a891-421f-9bf3-629e00afefdc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1292 microversion: 2.1 time: 0.381326 Oct 19 22:02:30.264691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 46/82] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1292 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:30.276905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:30.279962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:30.308468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:30.309170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:30.309658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:30.310380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:30.310837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:30.311309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:30.604278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:30.604278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0d2db0c6-06f3-4a92-81ae-92a6c3efa08a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1280 microversion: 2.1 time: 0.275111 Oct 19 22:02:30.604278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 47/83] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:30 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:30.604278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:30.604632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:30.604632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:30.604632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:30.604632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:30.604912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:30.604912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:30.604912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:30.627368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:30.648246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-66f633b2-cb16-4138-b1db-4e9ec2b3dc3f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.937736 Oct 19 22:02:30.650878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 37/84] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:29 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:30.738009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:30.759615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:30.769081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:30.770737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e9a2966-8e6d-421e-8ded-e663b673ff00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1339 microversion: 2.20 time: 0.223896 Oct 19 22:02:30.784464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 48/85] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:31.295140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:31.299608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:31.321927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:31.322743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:31.324055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:31.328472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:31.329071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:31.329599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:31.610542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:31.611886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:31.632393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:31.634931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:31.635274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:31.636071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:31.636641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:31.637177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:31.652034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:31.668482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-86a7734b-82db-4aef-bcc9-bc590a82783f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1298 microversion: 2.1 time: 0.376711 Oct 19 22:02:31.669140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 38/86] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1298 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:31.704198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:31.704892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:31.725559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:31.725559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:31.725559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:31.725559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:31.725974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:31.725974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:31.849688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:32.180328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:32.180328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f7a5a648-68bc-482c-82af-3b0772aef2c5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1280 microversion: 2.1 time: 0.542078 Oct 19 22:02:32.180328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 49/87] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:31 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1280 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:32.180328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:32.181953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:32.182185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:32.182680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:32.182680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:32.182680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:32.182680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:32.183120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-58de898e-145d-43bb-a671-929384afdba0 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.477850 Oct 19 22:02:32.183326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:32.183326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:32.183567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 39/88] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:31 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:32.547391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:32.556467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:32.557894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:32.567679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-686de7df-2df0-46cb-a48c-ff9eff34fb4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.408530 Oct 19 22:02:32.579380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 50/89] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:32.701823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:32.703915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:32.712382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:32.725227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:32.727497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:32.729414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:32.730642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:32.740954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:32.744539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.068814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=6 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:33.095737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:33.137895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-109b8b94-6503-4aec-89c5-0f9e85991b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1298 microversion: 2.1 time: 0.441008 Oct 19 22:02:33.141019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 40/90] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1298 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:33.217819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:33.229006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:33.232447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-50c48dea-6247-405e-a717-f6875b8ec76e req-61b66fdd-4c22-4645-8b69-4a0201b738b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2005ac4-9f7f-4daa-86e1-0e29a3167663", "tag": "da3df6f6-a999-415a-ad65-de5c162c6cf1"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:33.263636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.264753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.268697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.274769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.275643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.276454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.301069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-50c48dea-6247-405e-a717-f6875b8ec76e req-61b66fdd-4c22-4645-8b69-4a0201b738b2 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.304534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-50c48dea-6247-405e-a717-f6875b8ec76e req-61b66fdd-4c22-4645-8b69-4a0201b738b2 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.306016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-50c48dea-6247-405e-a717-f6875b8ec76e req-61b66fdd-4c22-4645-8b69-4a0201b738b2 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.345439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-50c48dea-6247-405e-a717-f6875b8ec76e req-61b66fdd-4c22-4645-8b69-4a0201b738b2 service nova] Creating event network-changed:da3df6f6-a999-415a-ad65-de5c162c6cf1 for instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 on hv-cinder-maste Oct 19 22:02:33.345989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-50c48dea-6247-405e-a717-f6875b8ec76e req-61b66fdd-4c22-4645-8b69-4a0201b738b2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121022) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 22:02:33.346383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-50c48dea-6247-405e-a717-f6875b8ec76e req-61b66fdd-4c22-4645-8b69-4a0201b738b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121022) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 22:02:33.347495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.347952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.348662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.349617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.350314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.351006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.361645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.compute.rpcapi [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 22:02:33.364640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] Releasing lock "compute-rpcapi-router" {{(pid=121022) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 22:02:33.384177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bd6a6a27-7bdc-4032-a211-99cef550cf2d None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.425280 Oct 19 22:02:33.385571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 51/91] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:02:33.391890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:33.392915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:33.401424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:33.403599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.404379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.405292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.406326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.407022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.407654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.539452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:33.555552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dddcb4de-58e5-49ad-84be-0c63e06c2a66 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1280 microversion: 2.1 time: 0.167051 Oct 19 22:02:33.556254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 52/92] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:33 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:33.608591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:33.608591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:33.608591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.608591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.608932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.608932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:33.609530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:33.610169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:33.614823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:33.633541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=28 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:34.069010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:34.074068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:34.075907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:34.077175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a0a2249b-6372-45fe-9338-444b10d8b9ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.483479 Oct 19 22:02:34.091583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 53/93] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:02:34.191584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-0691e47a-d10c-4f32-bc60-e1b844f6ca58 req-a24aee79-4d76-4b66-823d-42e54ad0bc52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91bd34e5-1035-4544-b76f-e925310a40cd", "tag": "06bb6cf8-0a6d-49a6-81f8-17c7292a8d5d"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:34.202159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:34.207090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0691e47a-d10c-4f32-bc60-e1b844f6ca58 req-a24aee79-4d76-4b66-823d-42e54ad0bc52 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:34.208179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0691e47a-d10c-4f32-bc60-e1b844f6ca58 req-a24aee79-4d76-4b66-823d-42e54ad0bc52 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:34.208785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0691e47a-d10c-4f32-bc60-e1b844f6ca58 req-a24aee79-4d76-4b66-823d-42e54ad0bc52 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:34.226483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3ba41660-d860-4cfb-8fee-268267a19520 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 1.022470 Oct 19 22:02:34.226911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-0691e47a-d10c-4f32-bc60-e1b844f6ca58 req-a24aee79-4d76-4b66-823d-42e54ad0bc52 service nova] Creating event network-changed:06bb6cf8-0a6d-49a6-81f8-17c7292a8d5d for instance 91bd34e5-1035-4544-b76f-e925310a40cd on hv-cinder-maste Oct 19 22:02:34.227414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 41/94] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:33 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:34.247064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:34.252000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:34.252143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-0691e47a-d10c-4f32-bc60-e1b844f6ca58 req-a24aee79-4d76-4b66-823d-42e54ad0bc52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157957 Oct 19 22:02:34.256754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 54/95] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:34.262803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:34.264066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:34.264967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:34.266606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:34.267613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:34.268470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:34.758088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:34.758088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:34.758088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=28 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:34.758088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:34.760991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:34.760991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:34.760991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:34.760991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:34.761287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:34.779041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:34.802643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ae22ded4-26e6-4127-aa9a-2874981699bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.573006 Oct 19 22:02:34.819588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 42/96] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:35.118804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:35.123041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:35.151129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.154383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.158215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.165834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.167307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.169008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.436965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:35.454854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fee26476-8125-496b-b3b2-3eaa7fd8c78a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.870257 Oct 19 22:02:35.459308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 55/97] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:34 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:35.462987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:35.475221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:35.492373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.492373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.492373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.492977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.493809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.494458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.773778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:35.781443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:35.783300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:35.784633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-96aee694-b6b9-46a5-b41a-e27b2d99f0e5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.680738 Oct 19 22:02:35.785709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 43/98] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:02:35.793934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-e780e84e-2438-4ba3-bf9a-7ed9efe952ec req-4eb89e83-37aa-4190-accc-c4550ec222cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:35.808071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e780e84e-2438-4ba3-bf9a-7ed9efe952ec req-4eb89e83-37aa-4190-accc-c4550ec222cb service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.808769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e780e84e-2438-4ba3-bf9a-7ed9efe952ec req-4eb89e83-37aa-4190-accc-c4550ec222cb service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.809360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e780e84e-2438-4ba3-bf9a-7ed9efe952ec req-4eb89e83-37aa-4190-accc-c4550ec222cb service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.831972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-e780e84e-2438-4ba3-bf9a-7ed9efe952ec req-4eb89e83-37aa-4190-accc-c4550ec222cb service nova] Creating event network-changed:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:02:35.832573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e780e84e-2438-4ba3-bf9a-7ed9efe952ec req-4eb89e83-37aa-4190-accc-c4550ec222cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 22:02:35.833777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e780e84e-2438-4ba3-bf9a-7ed9efe952ec req-4eb89e83-37aa-4190-accc-c4550ec222cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=121021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 22:02:35.835069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.835542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.836105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.837139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.837598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.838024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.857224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:35.862238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.compute.rpcapi [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 22:02:35.863175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] Releasing lock "compute-rpcapi-router" {{(pid=121021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 22:02:35.896694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-16204cd8-ba58-417b-b144-0af54c904fd5 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108762 Oct 19 22:02:35.898197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 44/99] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:35.907244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:35.908634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:35.920383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.921540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.922147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:35.923109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:35.923706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:35.924642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:36.283315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:36.300513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dbfd5c9d-3411-4ee9-86b3-a713e3ed1f81 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.843884 Oct 19 22:02:36.301117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 56/100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:35 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:36.480436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:36.481218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:36.507013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:36.507188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:36.507547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:36.508281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:36.511790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:36.515682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:36.776792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:36.815343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e50b4d8f-7ea0-457c-8b7b-ad51e6ba2dad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.886556 Oct 19 22:02:36.815343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 45/101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:36.836597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:36.837224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:36.858033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:36.858822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:36.859467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:36.862575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:36.862575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:36.862575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:37.102107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:37.113551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7259831c-6d9c-4047-94ec-ed8f0e528f8c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.637290 Oct 19 22:02:37.115106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 57/102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:36 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:37.262866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:37.273204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:37.275064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:37.276389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-83ef18ef-41f4-42b2-be62-94eff582e415 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.448394 Oct 19 22:02:37.276953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 46/103] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:37.328891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:37.329682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:37.337957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:37.337957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:37.337957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:37.338241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:37.338847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:37.339318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:37.710120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:37.717858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-83f2c66f-2d97-41e7-a6f0-bf657acb5a12 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.392645 Oct 19 22:02:37.723379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 58/104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:37 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:37.832796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:37.833399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:37.839496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:37.839986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:37.840422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:37.841107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:37.841558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:37.841979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:37.971429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:37.979717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-30e80385-3d51-4a71-a1dc-ec936990a9f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.150830 Oct 19 22:02:37.980291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 47/105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:38.093034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-89c4fa4d-8bb9-482a-b6b9-4dd17442b829 req-179575c0-be11-44c4-9975-305d05728be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c8aa232-0ce1-4e0a-a383-9543404033fd", "tag": "2503d797-46d9-4608-9c22-fea52cf1c79f"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:38.103749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-89c4fa4d-8bb9-482a-b6b9-4dd17442b829 req-179575c0-be11-44c4-9975-305d05728be9 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:38.106356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-89c4fa4d-8bb9-482a-b6b9-4dd17442b829 req-179575c0-be11-44c4-9975-305d05728be9 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:38.106356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-89c4fa4d-8bb9-482a-b6b9-4dd17442b829 req-179575c0-be11-44c4-9975-305d05728be9 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:38.118981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-89c4fa4d-8bb9-482a-b6b9-4dd17442b829 req-179575c0-be11-44c4-9975-305d05728be9 service nova] Creating event network-changed:2503d797-46d9-4608-9c22-fea52cf1c79f for instance 4c8aa232-0ce1-4e0a-a383-9543404033fd on hv-cinder-maste Oct 19 22:02:38.124168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-89c4fa4d-8bb9-482a-b6b9-4dd17442b829 req-179575c0-be11-44c4-9975-305d05728be9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037347 Oct 19 22:02:38.125421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 59/106] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:38.137462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:38.137571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:38.144406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:38.144952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:38.145919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:38.146777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:38.147409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:38.147985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:38.291558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:38.299685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5133fbec-df6c-4946-8b2d-580c83275818 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.166609 Oct 19 22:02:38.300476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 48/107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:38 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:38.302621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:38.303338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:38.312015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:38.315954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:38.315954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:38.315954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:38.315954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:38.316461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:38.501436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:38.510004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:38.511454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:38.512548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3b103a36-5f04-494f-9fdd-1c5efd566be0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.214600 Oct 19 22:02:38.513098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 60/108] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:02:38.745318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:38.745926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:38.751756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:38.754046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:38.754046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:38.754046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:38.754046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:38.754377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:38.915454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:38.921010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a40c4e99-ce35-4155-8b71-179c441d65d4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.179657 Oct 19 22:02:38.921587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 49/109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:38 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:39.003166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:39.003763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:39.011967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.011967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.011967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:39.012731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.013191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.013752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:39.163257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:39.170830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e7c30a08-d8b5-4b89-9079-4fa070902fc1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.171498 Oct 19 22:02:39.171407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 61/110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:39.326798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:39.326798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:39.351494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.352318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.353514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:39.354577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.355196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.355754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:39.501701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:39.512827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2c7f2242-d211-4dc3-bac1-6fe5c5604b07 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.192866 Oct 19 22:02:39.513784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 50/111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:39 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:39.538167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:39.539539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:39.549341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.549341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.552833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:39.556255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.557767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.558212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:39.751436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:39.763767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:39.765211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:39.766329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a90bfcca-4b1f-4b7d-9d01-86782d4936c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.232645 Oct 19 22:02:39.768543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 62/112] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:39.948251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:39.949905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:39.960181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.960830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.962048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:39.963169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:39.964008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:39.964698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.142174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-6a1d13cf-53c9-45f0-87ee-2921c98af52e req-0eb303e7-b817-4289-b07a-9da3674a0569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4d839a-a9cb-470c-b01b-b634c0057dd2", "tag": "c43f1a07-3986-4753-ac98-ab6d29e96671"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:40.164308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6a1d13cf-53c9-45f0-87ee-2921c98af52e req-0eb303e7-b817-4289-b07a-9da3674a0569 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:40.167867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:40.174405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6a1d13cf-53c9-45f0-87ee-2921c98af52e req-0eb303e7-b817-4289-b07a-9da3674a0569 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:40.273854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6a1d13cf-53c9-45f0-87ee-2921c98af52e req-0eb303e7-b817-4289-b07a-9da3674a0569 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.274385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b280c57b-37c7-4cca-9caa-1a2648fad199 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.253339 Oct 19 22:02:40.274385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 51/113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:39 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:40.274385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:40.274385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:40.274385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:40.274743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:40.274743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.274743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:40.274743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:40.275024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.275094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-6a1d13cf-53c9-45f0-87ee-2921c98af52e req-0eb303e7-b817-4289-b07a-9da3674a0569 service nova] Creating event network-changed:c43f1a07-3986-4753-ac98-ab6d29e96671 for instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 on hv-cinder-maste Oct 19 22:02:40.275094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-6a1d13cf-53c9-45f0-87ee-2921c98af52e req-0eb303e7-b817-4289-b07a-9da3674a0569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090838 Oct 19 22:02:40.275094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 63/114] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:02:40.369557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:40.378423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8b5d11ee-2812-46ba-b99f-7985b0c4836a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.176737 Oct 19 22:02:40.379114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 52/115] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:40.539582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:40.540506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:40.548100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:40.548941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:40.549639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.550659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:40.551993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:40.553120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.694280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:40.702849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78f7d659-2200-4e16-b8cd-e46246410f46 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.168788 Oct 19 22:02:40.705449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 64/116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:40 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:40.800112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:40.800727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:40.807397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:40.807884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:40.808318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.809006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:40.809458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:40.809878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:40.997289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:40.999629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:41.006248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:41.007700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-54101093-fda0-4607-8876-2e09c3b996d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.211461 Oct 19 22:02:41.008718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 53/117] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:41.225271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:41.226006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:41.234893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:41.235658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:41.236101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:41.236804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:41.237565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:41.238082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:41.428919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:41.428919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:41.428919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:41.428919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:41.429323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:41.429323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:41.429323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:41.429323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:41.466749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:41.479831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a3305d76-a50c-4b40-abad-41b8bab38888 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.259819 Oct 19 22:02:41.481299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 65/118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:41 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:41.620841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:41.630222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-67a38888-3171-4299-94ed-c7723b1f0fc9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.231140 Oct 19 22:02:41.632176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 54/119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:41.728910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:41.729949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:41.740750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:41.740750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:41.740750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:41.740750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:41.741225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:41.741225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:41.938180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:42.005235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7f67aa38-4bc0-4496-8be1-381529f996f7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.223704 Oct 19 22:02:42.005235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 66/120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:41 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:42.034530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:42.035300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:42.046609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:42.047330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:42.047976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:42.049263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:42.049787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:42.050281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:42.194280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:42.202678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:42.204400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:42.205237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-959c4132-5858-4bb8-94f0-dbd7438727d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.176382 Oct 19 22:02:42.205776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 55/121] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:42.505488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:42.506015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:42.512349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:42.512857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:42.513286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:42.513988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:42.514445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:42.514866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:42.654423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:42.656123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:42.664917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:42.666046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:42.666690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:42.667656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:42.668293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:42.669042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:42.854646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:42.862451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1d88eb68-f27f-4c66-ac90-fa57096d4a1d tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.361509 Oct 19 22:02:42.877467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 67/122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:42 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:42.986288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:42.986288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d3621350-3de0-4e04-9ae8-78a447e8dd9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.334627 Oct 19 22:02:42.986288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 56/123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:42.987175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:42.987962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:43.000041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:43.000703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:43.001153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:43.001932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:43.002382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:43.002806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:43.137708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:43.146027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-46c808ae-6212-42d0-a545-5cdc5f08646b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.162993 Oct 19 22:02:43.152439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 68/124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:42 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:43.229622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:43.230229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:43.236152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:43.236657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:43.237060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:43.237739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:43.238190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:43.238609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:43.387835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:43.396853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:43.398383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:43.399600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76042b54-69e4-4296-aafa-c447de4e66df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.173840 Oct 19 22:02:43.400230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 57/125] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:43.885310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:43.888053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:43.890086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:43.899304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:43.899806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:43.900240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:43.901109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:43.901567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:43.901991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:44.006856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:44.007535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:44.014349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:44.015097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:44.015584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:44.016732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:44.017335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:44.018119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:44.045814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:44.055552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d788b771-0012-4d8f-a918-00b9bf3dc674 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.174644 Oct 19 22:02:44.068409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 69/126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:43 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:44.154367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:44.164474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6c2b4348-b75e-490e-91d0-6aebca416b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.161486 Oct 19 22:02:44.165111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 58/127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:44.176111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:44.176768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:44.186448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:44.186448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:44.186448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:44.186448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:44.186783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:44.187068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:44.319033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:44.323140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37a3b7d7-388b-4e2a-b437-7b83150dcc10 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.150738 Oct 19 22:02:44.323704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 70/128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:44 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:44.425379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:44.425898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:44.432018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:44.432498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:44.433777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:44.433777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:44.434037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:44.434476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:44.563648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:44.572166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:44.573593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:44.574691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9d872000-c45b-4ac5-a110-191f64688e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.153414 Oct 19 22:02:44.575269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 59/129] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:45.083161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:45.084213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:45.094745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.095555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.096255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.098143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.098253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.098929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.187621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:45.188234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:45.195120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.195631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.196040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.196734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.197187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.197606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.231655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:45.235026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:45.240299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0e70b2bf-f977-4b8b-9242-592a78a39dbe tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.164661 Oct 19 22:02:45.251536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 71/130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:45 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:45.329388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:45.345234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03256c0e-7aa0-484c-aa03-688a19ebb174 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.153468 Oct 19 22:02:45.345234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 60/131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:45.345568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:45.346174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:45.353409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.353915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.354346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.355175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.355556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.355976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.486297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:45.494733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1c553536-7d8e-4a6a-b630-8fc809b7e9e1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.153058 Oct 19 22:02:45.495315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 72/132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:45 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:45.600635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:45.601380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:45.610907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.610907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.610907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.610907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:45.611300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:45.611300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:45.627812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:45.735724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:45.743454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:45.744915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:45.746000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4e5582df-cebd-40c7-80e5-b33617d6d63d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.149737 Oct 19 22:02:45.746551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 61/133] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:46.263966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:46.264439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:46.271031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.271517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.271950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.272635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.273085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.273503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.361239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:46.361836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:46.364080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:46.372680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.375008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.375008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.375008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.375008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.375335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.409582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:46.416320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2348a3f-cfc9-42d5-b05b-0fab3302bc2a tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.156342 Oct 19 22:02:46.416889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 73/134] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:46 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:46.524621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:46.525760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:46.533763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:46.547557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.547691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2446ce26-4c96-4eea-a8f2-748d3fc4df71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.190516 Oct 19 22:02:46.548049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.552513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.558577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.559315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.559945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.564470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 62/135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:46.771930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:46.772514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:46.780200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.780838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.781283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.789613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:46.790105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:46.792055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:46.852507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:46.860610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0d6922da-53dc-4a45-85b4-8cc86a595de6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.346965 Oct 19 22:02:46.861173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 74/136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:46 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:46.936319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:46.944739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:46.946161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:46.947469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-740b4642-557b-40d6-ab9e-b49fc6cb610e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.181079 Oct 19 22:02:46.948019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 63/137] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:47.440958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:47.446206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:47.449285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.450039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.450611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:47.451501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.452212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.452813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:47.584494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:47.584494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:47.592728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.593401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.597344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:47.598115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.598558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.601629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:47.671911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:47.681671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d7571c4-4f8d-4b88-a689-b4c1462b47a4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.245176 Oct 19 22:02:47.692716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 75/138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:47 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:47.766396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:47.774004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1d4ba87d-e4fa-4773-b09d-0f97c9cbd8ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.203749 Oct 19 22:02:47.774572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 64/139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:47.882806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:47.883612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:47.890601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.896923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.897665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:47.898406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.899062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.899490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:47.971737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:47.972409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:47.985875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.987049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.987682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:47.989356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:47.989567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:47.991376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:48.056339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:48.065781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eb247ffe-e6ce-41c8-bcc3-597462f0e132 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.186710 Oct 19 22:02:48.070621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 76/140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:47 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:48.151322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-1b03966d-2a13-4397-8c33-74e1b18d8915 req-0fe6318b-5a29-4136-9f1a-26fe4ebfc4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2005ac4-9f7f-4daa-86e1-0e29a3167663", "name": "network-vif-plugged", "status": "completed", "tag": "da3df6f6-a999-415a-ad65-de5c162c6cf1"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:48.156348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:48.162217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1b03966d-2a13-4397-8c33-74e1b18d8915 req-0fe6318b-5a29-4136-9f1a-26fe4ebfc4e8 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:48.167421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1b03966d-2a13-4397-8c33-74e1b18d8915 req-0fe6318b-5a29-4136-9f1a-26fe4ebfc4e8 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:48.167421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1b03966d-2a13-4397-8c33-74e1b18d8915 req-0fe6318b-5a29-4136-9f1a-26fe4ebfc4e8 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:48.170632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:48.172410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:48.173540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-256c0f6d-653b-4f59-9b7a-d6eb97500795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.205723 Oct 19 22:02:48.174731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 65/141] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:02:48.187970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-1b03966d-2a13-4397-8c33-74e1b18d8915 req-0fe6318b-5a29-4136-9f1a-26fe4ebfc4e8 service nova] Creating event network-vif-plugged:da3df6f6-a999-415a-ad65-de5c162c6cf1 for instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 on hv-cinder-maste Oct 19 22:02:48.198658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-1b03966d-2a13-4397-8c33-74e1b18d8915 req-0fe6318b-5a29-4136-9f1a-26fe4ebfc4e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131207 Oct 19 22:02:48.199309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 77/142] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:48.704932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:48.705538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:48.711818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:48.712289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:48.712714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:48.713390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:48.713840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:48.714307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:48.798274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:48.799122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:48.814284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:48.814936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:48.818081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:48.818081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:48.818081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:48.818081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:48.878874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:48.887816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cbec5359-71c5-4216-8076-5b5b804b07e3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.186586 Oct 19 22:02:48.888396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 66/143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:48 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:48.968743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:48.976375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dfa73b50-7b49-4daf-b354-3212194b5545 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.183614 Oct 19 22:02:48.976932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 78/144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:49.088183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:49.088815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:49.097686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:49.098716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:49.099309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:49.104344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:49.104344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:49.104344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:49.205443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:49.205443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:49.210847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:49.211893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:49.218689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:49.219415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:49.219920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:49.220340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:49.295762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:49.304560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8034b675-cf57-4309-8a2d-a82c832b6cb8 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.220173 Oct 19 22:02:49.305204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 67/145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:49 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:49.376220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:49.386645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:49.388178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:49.389385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-707c697a-4227-4565-8d0b-769111bb6a31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.189797 Oct 19 22:02:49.389950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 79/146] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:49.911766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:49.912364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:49.918621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:49.919142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:49.919574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:49.920251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:49.920702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:49.921216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:49.999780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:50.000395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:50.006699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:50.007163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:50.007597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:50.008294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:50.008749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:50.009176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:50.048792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:50.057464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-75f4dd20-943a-43b3-94be-fe8d41c4b9f4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.150050 Oct 19 22:02:50.059905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 68/147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:49 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:50.143289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:50.151578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6813518f-8a87-4d74-aa82-bcd692afc948 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.155645 Oct 19 22:02:50.152146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 80/148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:50.329423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:50.330201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:50.336342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:50.339156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:50.339156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:50.339156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:50.339156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:50.339753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:50.416440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:50.417123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:50.423346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:50.423832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:50.424265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:50.424985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:50.425532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:50.425814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:50.517573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:50.526428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b5b2b99f-be7d-4cda-9939-a41ff7021c2b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.202410 Oct 19 22:02:50.527342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 69/149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:50 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:50.561434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:50.569485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:50.570918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:50.572054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9ce22703-f093-4f14-84c3-089d4995a457 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.159815 Oct 19 22:02:50.572927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 81/150] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:02:51.080740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:51.081504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:51.091433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.092796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.093418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:51.094341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.094992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.096258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:51.181807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:51.191470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:51.210077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.210628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.211444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:51.213114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.213712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.214427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:51.371147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:51.381019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-035bf03f-adbd-49e8-b3e9-7245ce4c823c tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.304087 Oct 19 22:02:51.384536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 70/151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:51 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:51.551025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:51.552031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:51.566803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.568068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.568597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:51.570909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.571668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.579754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:51.859326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:51.870368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2a75eaa8-7520-4c2f-b270-b28bcd9fce5f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.697948 Oct 19 22:02:51.882982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 82/152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:51.887665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:51.888527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:51.896247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.897592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.898287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:51.899756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:51.900474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:51.901068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:52.042897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:52.053856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac28caa7-40ca-476c-baee-c197beab52f5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.507525 Oct 19 22:02:52.068183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 71/153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:51 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:52.075840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-009abb21-2801-48df-8503-4002d4f71a5f req-76132984-2338-47c3-bc3b-365212de0e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bd34e5-1035-4544-b76f-e925310a40cd", "name": "network-vif-plugged", "status": "completed", "tag": "06bb6cf8-0a6d-49a6-81f8-17c7292a8d5d"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:52.088832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-009abb21-2801-48df-8503-4002d4f71a5f req-76132984-2338-47c3-bc3b-365212de0e1c service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:52.090495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-009abb21-2801-48df-8503-4002d4f71a5f req-76132984-2338-47c3-bc3b-365212de0e1c service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:52.091219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-009abb21-2801-48df-8503-4002d4f71a5f req-76132984-2338-47c3-bc3b-365212de0e1c service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:52.105427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-009abb21-2801-48df-8503-4002d4f71a5f req-76132984-2338-47c3-bc3b-365212de0e1c service nova] Creating event network-vif-plugged:06bb6cf8-0a6d-49a6-81f8-17c7292a8d5d for instance 91bd34e5-1035-4544-b76f-e925310a40cd on hv-cinder-maste Oct 19 22:02:52.112108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-009abb21-2801-48df-8503-4002d4f71a5f req-76132984-2338-47c3-bc3b-365212de0e1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042557 Oct 19 22:02:52.113256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 72/154] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:52.406771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:52.414555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:52.415698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:52.416535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:52.416687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:52.417622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:52.418532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:52.419175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:52.419744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:52.448076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:52.450294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:52.451602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37e1d113-bc23-4af2-bfcf-fb124534e75c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.579210 Oct 19 22:02:52.453188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 83/155] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:52.634811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:52.642325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b8170d8-054d-4873-a260-0f2cb9793eb3 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.239996 Oct 19 22:02:52.642889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 73/156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:52 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:52.896199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:52.896808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:52.902685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:52.903210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:52.903700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:52.904324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:52.904769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:52.905183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:53.050681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:53.059470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9fb09067-29f3-423d-894d-f7e44ff1f6e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.167541 Oct 19 22:02:53.060231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 84/157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:53.081744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:53.083114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:53.089238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:53.089822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:53.090150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:53.090834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:53.091295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:53.091712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:53.246413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:53.255403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-996ec261-692f-4148-b0f0-be01cf4273b3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.176825 Oct 19 22:02:53.264575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 74/158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:53 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:53.485663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:53.486276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:53.492862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:53.493349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:53.493775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:53.494465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:53.494916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:53.495360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:53.635230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:53.643398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:53.644847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:53.646054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-43156eb3-6782-4de6-a8c6-9a2e204e4b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.164255 Oct 19 22:02:53.646613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 85/159] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:53.666342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:53.666964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:53.672875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:53.673349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:53.673775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:53.674450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:53.674917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:53.675972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:53.867351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:53.875994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a43dcee4-2063-446b-bd96-1c89c68b9d04 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.213717 Oct 19 22:02:53.888156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 75/160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:53 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:54.084021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:54.084623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:54.090819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.091342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.091790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:54.092479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.092935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.093379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:54.268593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:54.279481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-be4a8cb7-4f93-4e90-ba5b-87c5072814fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.200154 Oct 19 22:02:54.280065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 86/161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:54.285735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:54.291990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:54.303584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.310240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.310732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:54.313104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.314521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.316282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:54.505941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:54.518135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ed4cef4a-6611-4738-83ad-87f783bbb821 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.243074 Oct 19 22:02:54.522851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 76/162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:54 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:54.670443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:54.671286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:54.678063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.678639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.679172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:54.679940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.680465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.680977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:54.828761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:54.836881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:54.838321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:54.839450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-36afb2c4-0d80-4dc5-a866-43afc1b44ea7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.173154 Oct 19 22:02:54.840007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 87/163] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:54.900659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:54.901515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:54.907983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.908475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.909048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:54.909768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:54.910322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:54.910747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:55.049294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:55.058298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e70eec0-dedc-4da3-b019-1552c548d676 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.162066 Oct 19 22:02:55.058880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 77/164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:54 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:55.312109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:55.312807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:55.319264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:55.319824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:55.320326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:55.321082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:55.321601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:55.322124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:55.476834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:55.484714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69d441d6-1d10-4c18-b6bb-43d93d3970a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.176553 Oct 19 22:02:55.485523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 88/165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:55.541966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:55.545200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:55.554797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:55.565409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:55.565409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:55.565409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:55.565409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:55.566317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:55.792843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:55.792843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:55.798264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dee4101f-f3d4-4fc6-b4a4-7ee8f49355da tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.260278 Oct 19 22:02:55.811095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 78/166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:55 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:55.863949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:55.864680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:55.870944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:55.871547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:55.872055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:55.872820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:55.873503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:55.874011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:55.878463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:02:56.015135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:56.023711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:56.025159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:56.026256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6f088049-5666-459b-a562-ad630f610c1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.166294 Oct 19 22:02:56.026823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 89/167] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:56.080711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:56.081303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:56.088153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:56.091550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:56.091550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:56.091550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:56.091550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:56.091833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:56.227072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:56.234698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7dab9c5c-c74d-4965-bbdd-d729c02094ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.157791 Oct 19 22:02:56.235529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 79/168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:56 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:56.507916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:56.508438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:56.514391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:56.514872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:56.515394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:56.516077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:56.516523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:56.517108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:56.644197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:56.651891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e19b145f-d9a5-404b-8f3d-a8f00f14a1af tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.148965 Oct 19 22:02:56.652542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 90/169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:56.835211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:56.836682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:56.844058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:56.844845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:56.845499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:56.846560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:56.852375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:56.853067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:57.018544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:57.029270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fdfb31fb-f389-4fa8-9e89-b265adb4d398 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.198776 Oct 19 22:02:57.030782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 80/170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:56 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:57.062762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:57.063408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:57.074098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:57.076973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:57.076973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:57.076973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:57.077240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:57.077887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:57.261205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:57.261205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:57.264951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:57.265643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:57.266220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:57.267106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:57.267699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:57.268284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:57.337320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:57.353816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:57.359697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:57.364039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fa936122-fa87-496c-9717-6c5f8cbf514c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.313894 Oct 19 22:02:57.365959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 91/171] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:57.443704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:57.456651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9836a29-3b16-4596-b199-551f904b6e31 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.198718 Oct 19 22:02:57.458316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 81/172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:57 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:57.679862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:57.680592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:57.688034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:57.688518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:57.689211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:57.690181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:57.690897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:57.691410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:57.841008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:57.849544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1b57fe9f-86f0-4362-b5a0-dd597ea7eed0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.178743 Oct 19 22:02:57.850305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 92/173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:58.061305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:58.061305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:58.069939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.069939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.069939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.069939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.070204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.070204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.205530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:58.213139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-04960515-8089-42be-8a4e-eb20be0d155a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.163342 Oct 19 22:02:58.213718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 82/174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:58 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:58.389869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:58.390515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:58.396988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.399081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.399081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.399081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.399081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.399443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.496295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:58.497904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:58.521215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.521712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.523197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.524121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.524861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.525294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.590943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:58.605109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:58.607941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:58.610103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4ae704e6-4417-4fea-badb-6afbb319ebd6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.224125 Oct 19 22:02:58.619208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 93/175] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:58.734108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:58.742581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-83a33d26-c5c7-4dfe-86e3-476393284b96 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1315 microversion: 2.1 time: 0.258566 Oct 19 22:02:58.743213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 83/176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:58 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:58.837677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-61d0b7bf-ee91-463b-b7ed-b89ad858f1cf req-af58be79-7430-4564-a880-26c53b5b063b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "name": "network-vif-plugged", "status": "completed", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:02:58.854524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-61d0b7bf-ee91-463b-b7ed-b89ad858f1cf req-af58be79-7430-4564-a880-26c53b5b063b service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.855356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-61d0b7bf-ee91-463b-b7ed-b89ad858f1cf req-af58be79-7430-4564-a880-26c53b5b063b service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.856159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-61d0b7bf-ee91-463b-b7ed-b89ad858f1cf req-af58be79-7430-4564-a880-26c53b5b063b service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.869022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-61d0b7bf-ee91-463b-b7ed-b89ad858f1cf req-af58be79-7430-4564-a880-26c53b5b063b service nova] Creating event network-vif-plugged:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:02:58.873252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:58.873944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:58.882613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.886056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.886769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:58.889162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-61d0b7bf-ee91-463b-b7ed-b89ad858f1cf req-af58be79-7430-4564-a880-26c53b5b063b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054731 Oct 19 22:02:58.895698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 94/177] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:02:58.895848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:58.895848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:58.895848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:59.105666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:59.113210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-afbbb300-e5db-45c1-8293-2cb51070f109 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.243956 Oct 19 22:02:59.113797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 84/178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:02:59.236338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:59.237029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:59.245417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:59.245973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:59.246747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:59.247937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:59.248536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:59.249102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:59.388478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:59.397258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0d01d81d-e9b4-4a4a-9e02-bee2fe6cae34 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.165397 Oct 19 22:02:59.398652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 95/179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:59 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:02:59.636123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:59.636731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:59.642683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:59.643197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:59.643624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:59.644301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:59.644747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:59.645237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:59.769263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:02:59.769263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:02:59.775706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:59.776817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:59.777482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:59.778270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:02:59.778828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:02:59.779373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:02:59.823827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:59.832748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:59.834198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:59.835390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2204327d-0100-4737-a774-3d19c1e21385 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.203268 Oct 19 22:02:59.835885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 85/180] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:02:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:02:59.929232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:02:59.937561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-14cb4174-4fe5-44ab-a183-ed4299c6b42b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1502 microversion: 2.1 time: 0.175573 Oct 19 22:02:59.941801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 96/181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:02:59 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:00.135599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:00.136741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:00.142821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:00.143345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:00.143780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:00.144483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:00.145446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:00.145904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:00.289284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:00.295683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f0435c73-ad09-4a4b-816d-51f0177fc4f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.164197 Oct 19 22:03:00.297012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 86/182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:00.420225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:00.420764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:00.426607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:00.427123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:00.427581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:00.428525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:00.428978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:00.429401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:00.562395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:00.570892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7b22fc59-abe6-4624-bfb1-7a22eab7463f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.154593 Oct 19 22:03:00.571518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 97/183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:00 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:00.860167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:00.860887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:00.869322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:00.869885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:00.870400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:00.871281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:00.871940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:00.872534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:01.020723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:01.025625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:01.027120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:01.028221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0198b8b5-26c0-4bd9-8012-a9335d630003 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.171991 Oct 19 22:03:01.028777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 87/184] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:03:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:03:01.319004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:01.319609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:01.325593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:01.326073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:01.326658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:01.327297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:01.327748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:01.328774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:01.468373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:01.475982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f2bdc260-51ce-4e34-b25f-c77fd28518e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.160790 Oct 19 22:03:01.476914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 98/185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:01.593661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:01.594335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:01.600998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:01.601767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:01.602203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:01.603101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:01.603355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:01.603774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:01.738056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:01.746184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-04c68bc4-28ce-4fa1-9702-870ee5c5766d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.156456 Oct 19 22:03:01.746757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 88/186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:01 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:02.053494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:02.056867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:02.060580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:02.061970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:02.062750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:02.063483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:02.064141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:02.064545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:02.197139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:02.205244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:02.216202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:02.216202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-103befe4-7ec3-4101-a790-325394d3c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.158494 Oct 19 22:03:02.216202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 99/187] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:03:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:03:02.499911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:02.500654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:02.507479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:02.508215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:02.508890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:02.509670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:02.510192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:02.510685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:02.560201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-610c38f9-ce01-4f7b-a39b-9c37216eec79 req-c1251b93-729c-4d27-80b9-0e4c6a4cf4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4d839a-a9cb-470c-b01b-b634c0057dd2", "name": "network-vif-plugged", "status": "completed", "tag": "c43f1a07-3986-4753-ac98-ab6d29e96671"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:02.573634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-610c38f9-ce01-4f7b-a39b-9c37216eec79 req-c1251b93-729c-4d27-80b9-0e4c6a4cf4fe service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:02.574112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-610c38f9-ce01-4f7b-a39b-9c37216eec79 req-c1251b93-729c-4d27-80b9-0e4c6a4cf4fe service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:02.574535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-610c38f9-ce01-4f7b-a39b-9c37216eec79 req-c1251b93-729c-4d27-80b9-0e4c6a4cf4fe service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:02.589470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-610c38f9-ce01-4f7b-a39b-9c37216eec79 req-c1251b93-729c-4d27-80b9-0e4c6a4cf4fe service nova] Creating event network-vif-plugged:c43f1a07-3986-4753-ac98-ab6d29e96671 for instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 on hv-cinder-maste Oct 19 22:03:02.594265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-610c38f9-ce01-4f7b-a39b-9c37216eec79 req-c1251b93-729c-4d27-80b9-0e4c6a4cf4fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037612 Oct 19 22:03:02.594865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 100/188] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:02.672845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:02.682535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2d08f558-236f-4690-bde5-73c639c16c7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.187243 Oct 19 22:03:02.683607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 89/189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:02.769668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:02.770358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:02.777064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:02.777543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:02.777978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:02.778652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:02.779131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:02.779547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:02.910401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:02.918237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e378978c-2269-4f1f-b4a7-33150893e424 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.152732 Oct 19 22:03:02.918804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 101/190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:02 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:03.104647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80c2e4b6-a0ab-48d1-92ab-9415d39af436"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:03.107135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:03.110006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:03.113503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.113994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.114428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:03.115670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.116121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.116534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:03.237983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:03.239121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:03.244775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:03.248168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.248652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.249082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:03.249777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.250225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.250818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:03.395419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:03.400625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:03.402384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:03.403707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-08c9d64d-1879-4ba6-97c9-5521509a1eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1407 microversion: 2.20 time: 0.172274 Oct 19 22:03:03.404344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 102/191] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:03:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:03:03.706260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:03.707189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:03.714191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.714757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.715292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:03.716169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.716620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.717342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:03.851554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:03.860606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bb8f4c01-b090-4255-969f-6d3d268a2768 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.158462 Oct 19 22:03:03.876059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 103/192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:03.943281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:03.946158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:03.956805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.957278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.963273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:03.965052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:03.965052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:03.965539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:04.115110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:04.129761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6fe770ac-47a5-4eb4-bb79-2fbd13ec1062 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.192269 Oct 19 22:03:04.130327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 104/193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:03 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:04.429894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:04.430534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:04.436675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:04.437162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:04.437590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:04.438279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:04.438868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:04.439468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:04.588188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:04.596621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:04.598814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:04.604406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7e659ed3-1493-4be1-9587-e82f26481b2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1600 microversion: 2.20 time: 0.175085 Oct 19 22:03:04.604406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 105/194] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:03:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:03:04.627457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:04.627457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:04.632508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:04.632989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:04.633450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:04.634305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:04.634752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:04.635191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:04.755273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-65978ab3-4f56-4107-a6c4-450b932f67ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133891 Oct 19 22:03:04.759555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 106/195] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 19 22:03:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:03:04.885187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:04.889924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:04.895978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:04.896591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:04.897184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:04.898128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:04.898663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:04.899183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:04.927388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:05.147791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:05.157984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-817c2cbe-8b46-47ea-9b8a-1f66fe2eebc8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.276643 Oct 19 22:03:05.158970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 107/196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:05.164324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:05.165244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:05.171283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:05.174198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:05.174198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:05.174198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:05.174198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:05.174508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:05.681906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:05.698320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c3e2253b-8437-48d8-a24d-fe6419e989ff tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.538022 Oct 19 22:03:05.699218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 108/197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:05 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:06.181848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:06.182486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:06.188489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:06.189335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:06.189335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:06.190151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:06.190616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:06.191145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:06.420827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:06.431606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b31e7901-4eee-4d7a-aca3-43bfda1fbbac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.254377 Oct 19 22:03:06.432295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 109/198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:06.437068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-6afbc1cb-a1c3-4076-91cf-2855907d9289 req-a8975e1d-9749-4796-be9f-e302567e57bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:06.446391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6afbc1cb-a1c3-4076-91cf-2855907d9289 req-a8975e1d-9749-4796-be9f-e302567e57bf service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:06.447030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6afbc1cb-a1c3-4076-91cf-2855907d9289 req-a8975e1d-9749-4796-be9f-e302567e57bf service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:06.447559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6afbc1cb-a1c3-4076-91cf-2855907d9289 req-a8975e1d-9749-4796-be9f-e302567e57bf service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:06.459407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-6afbc1cb-a1c3-4076-91cf-2855907d9289 req-a8975e1d-9749-4796-be9f-e302567e57bf service nova] Creating event network-changed:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:03:06.464794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-6afbc1cb-a1c3-4076-91cf-2855907d9289 req-a8975e1d-9749-4796-be9f-e302567e57bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031106 Oct 19 22:03:06.465664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 110/199] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:06.723418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:06.724119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:06.737850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:06.745594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:06.745594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:06.745594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:06.745594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:06.746325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:06.887294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:06.895008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-735e0426-a5b7-4b75-8cdc-c32dc8c9ba6f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.176905 Oct 19 22:03:06.895576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 111/200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:06 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:07.460171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:07.460171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:07.463933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:07.464429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:07.467074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:07.467829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:07.468297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:07.469918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:07.882504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:07.890601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-57f10a17-d61c-4445-afe1-e84dd8e3c5fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.438959 Oct 19 22:03:07.891723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 112/201] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:07.919235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:07.920220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:07.926844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:07.928269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:07.928877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:07.929661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:07.930324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:07.930840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:08.089419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:08.097254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69580f5b-49ad-4f79-85ad-a54431603e8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.182262 Oct 19 22:03:08.097817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 113/202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:07 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:08.385063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4fe70c4-7632-469c-ba8e-132242804df6 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "POST /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.284145 Oct 19 22:03:08.385738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 90/203] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:03:03 2022] POST /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663/os-volume_attachments => generated 194 bytes in 5286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:08.915197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:08.915890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:08.922260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:08.922934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:08.923393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:08.924094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:08.924577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:08.925320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:09.088519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:09.096427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c6a80c57-3040-4237-9c99-8e4cf91c2df3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.186467 Oct 19 22:03:09.097031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 114/204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:09.123230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:09.123868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:09.130002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:09.131291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:09.131497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:09.132185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:09.132641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:09.133075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:09.264659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:09.272326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-33f587d6-d418-4c51-82ef-879b7d006450 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.153917 Oct 19 22:03:09.272885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 91/205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:09 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:10.119400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:10.120119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:10.125906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:10.126387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:10.126823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:10.127537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:10.128009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:10.128414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:10.259888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:10.267420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ee56ebd-66b0-464f-890a-a8785e8a1920 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.152548 Oct 19 22:03:10.267987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 115/206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:10.295903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:10.296504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:10.304033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:10.304525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:10.304954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:10.305652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:10.306105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:10.306529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:10.437670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:10.445604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6de60e0-db9d-4787-868c-8e0164048c0a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.153553 Oct 19 22:03:10.446170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 92/207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:10 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:11.292912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:11.293611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:11.299931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:11.300487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:11.300995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:11.301777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:11.302233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:11.303492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:11.472118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:11.473780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:11.484461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:11.485966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:11.486446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:11.487999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:11.488555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:11.489027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:11.690693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:11.707637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-014fdd5b-2860-4308-936b-c11c212da82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1365 microversion: 2.1 time: 0.417268 Oct 19 22:03:11.707637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 116/208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:11.712756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:11.715039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-5fe280ef-24de-4f33-a300-4ba7fd76dafe req-61d960cb-b37b-451f-a9f2-82aeabdd9cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8aa232-0ce1-4e0a-a383-9543404033fd", "name": "network-vif-plugged", "status": "completed", "tag": "2503d797-46d9-4608-9c22-fea52cf1c79f"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:11.721629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-70920cee-ef4c-4d08-9075-f1f18fecf84a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.257080 Oct 19 22:03:11.722197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 93/209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:11 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:11.726943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-5fe280ef-24de-4f33-a300-4ba7fd76dafe req-61d960cb-b37b-451f-a9f2-82aeabdd9cd5 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:11.727524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-5fe280ef-24de-4f33-a300-4ba7fd76dafe req-61d960cb-b37b-451f-a9f2-82aeabdd9cd5 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:11.727956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-5fe280ef-24de-4f33-a300-4ba7fd76dafe req-61d960cb-b37b-451f-a9f2-82aeabdd9cd5 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:11.729620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1185265130", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "networks": [{"uuid": "275a8c53-9b34-4fa1-b26b-d3a2b74fcd81"}]}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:11.739552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-5fe280ef-24de-4f33-a300-4ba7fd76dafe req-61d960cb-b37b-451f-a9f2-82aeabdd9cd5 service nova] Creating event network-vif-plugged:2503d797-46d9-4608-9c22-fea52cf1c79f for instance 4c8aa232-0ce1-4e0a-a383-9543404033fd on hv-cinder-maste Oct 19 22:03:11.745279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-5fe280ef-24de-4f33-a300-4ba7fd76dafe req-61d960cb-b37b-451f-a9f2-82aeabdd9cd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037354 Oct 19 22:03:11.749896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 117/210] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:11.797050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] validate_networks() for [('275a8c53-9b34-4fa1-b26b-d3a2b74fcd81', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:03:12.175845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:03:12.176315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:03:12.176807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:03:12.177204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:03:12.177643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:03:12.186917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.187418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.187860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.188568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.189054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.189474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.197094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:12.227291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Getting quotas for project 6ec4ff60137544109a46d3a5810251f5. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:03:12.232137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Getting quotas for user 7ea5afc217f843389fe051b42616e09d and project 6ec4ff60137544109a46d3a5810251f5. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:03:12.262856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:03:12.277663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:03:12.453008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-05dc0b84-f7a1-4e3f-a76f-b7bf69e89cfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728348 Oct 19 22:03:12.453324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 94/211] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:03:12.466968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3c80ced7-fc8b-4035-bda1-6393ff996b40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:12.472502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3c80ced7-fc8b-4035-bda1-6393ff996b40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:12.540350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3c80ced7-fc8b-4035-bda1-6393ff996b40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:12.558873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3c80ced7-fc8b-4035-bda1-6393ff996b40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1219 microversion: 2.1 time: 0.087730 Oct 19 22:03:12.570923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 118/212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:12 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:12.734193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:12.734799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:12.745160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.745699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.746138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.746844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.747332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.747756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.758976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:12.759926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:12.767587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.768169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.768998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.769947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.770557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.771255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.884725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:12.893116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e21016ba-eb97-4878-b739-218747ca1135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1555 microversion: 2.1 time: 0.163462 Oct 19 22:03:12.893672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 95/213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:12.917417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:12.917905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:12.924132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.924614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.925051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.925954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:12.926407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:12.927061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:12.928997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:12.937276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-16e6dda5-d4b3-4db1-83dc-8d82c4a809a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.192528 Oct 19 22:03:12.951100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 119/214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:12 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:13.008710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cf6f5bb4-cbfa-4971-9301-70d318940f4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095279 Oct 19 22:03:13.009303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 96/215] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 19 22:03:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:03:13.577876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-42787fa5-2d3d-405f-8d47-e3ad16307d89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:13.578782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-42787fa5-2d3d-405f-8d47-e3ad16307d89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:13.639468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-42787fa5-2d3d-405f-8d47-e3ad16307d89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:13.647159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-42787fa5-2d3d-405f-8d47-e3ad16307d89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1219 microversion: 2.1 time: 0.072690 Oct 19 22:03:13.648085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 120/216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:13 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:13.962605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:13.963246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:13.970608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:13.971192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:13.971639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:13.972720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:13.973189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:13.973741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:14.195740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:14.203990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d87cf3f9-9fd2-4b98-a0ff-55f289cee575 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1322 microversion: 2.1 time: 0.246428 Oct 19 22:03:14.204807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 97/217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:13 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:14.528516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-084ac200-cd05-48fe-9be5-8fb5911eb988 req-0cd70d43-cd00-4024-b51b-157817a2395f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4d839a-a9cb-470c-b01b-b634c0057dd2", "tag": "c43f1a07-3986-4753-ac98-ab6d29e96671"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:14.538060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-084ac200-cd05-48fe-9be5-8fb5911eb988 req-0cd70d43-cd00-4024-b51b-157817a2395f service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:14.538537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-084ac200-cd05-48fe-9be5-8fb5911eb988 req-0cd70d43-cd00-4024-b51b-157817a2395f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:14.538984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-084ac200-cd05-48fe-9be5-8fb5911eb988 req-0cd70d43-cd00-4024-b51b-157817a2395f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:14.551485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-084ac200-cd05-48fe-9be5-8fb5911eb988 req-0cd70d43-cd00-4024-b51b-157817a2395f service nova] Creating event network-changed:c43f1a07-3986-4753-ac98-ab6d29e96671 for instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 on hv-cinder-maste Oct 19 22:03:14.558385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-084ac200-cd05-48fe-9be5-8fb5911eb988 req-0cd70d43-cd00-4024-b51b-157817a2395f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033551 Oct 19 22:03:14.559377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 121/218] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:14.671368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:14.672135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:14.681313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:14.682872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:14.684162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:14.686116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:14.686619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:14.687114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:14.764501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:14.776094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-79ae9007-7e25-419b-885f-88cc846d4bf6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1223 microversion: 2.1 time: 0.108943 Oct 19 22:03:14.777597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 98/219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:14 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:15.232422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:15.232422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:15.237324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:15.237885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:15.238717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:15.239437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:15.239986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:15.241021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:15.435619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:15.444885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3ba93173-025e-4d10-85fc-96c7613fa8fd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1515 microversion: 2.1 time: 0.218838 Oct 19 22:03:15.445230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 122/220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:15 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:15.473546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:15.473546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:15.479804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:15.479804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:15.479804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:15.479804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:15.480150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:15.480150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:15.506555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lazy-loading 'flavor' on Instance uuid 4c8aa232-0ce1-4e0a-a383-9543404033fd {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:03:15.800922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:15.801528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:15.807953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:15.808440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:15.808891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:15.809571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:15.810017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:15.810462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:15.877810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:15.884794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bf20bd57-4dfc-418d-bf78-ffeb7e3d8a2c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1215 microversion: 2.1 time: 0.087709 Oct 19 22:03:15.885368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 123/221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:15 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:15.986799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-363acfdd-95e2-4ae5-b745-129a00662e02 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd/action" status: 200 len: 32 microversion: 2.1 time: 0.521104 Oct 19 22:03:15.986799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 99/222] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:03:15 2022] POST /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd/action => generated 32 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 22:03:15.994520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:15.995167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:16.001177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:16.001657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:16.002354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:16.003079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:16.003536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:16.003954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:16.131968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:16.139513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69e6f3bf-0542-4f7b-b4d7-89424c2543c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.149020 Oct 19 22:03:16.140081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 124/223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:15 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:16.916871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:16.917625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:16.924257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:16.924744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:16.925182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:16.925865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:16.926315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:16.926739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:16.988993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:16.997807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-79a87e02-7d95-44da-ae66-ecd3f761fa46 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1215 microversion: 2.1 time: 0.087071 Oct 19 22:03:17.003078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 100/224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:16 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:17.161525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:17.162093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:17.168845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:17.169321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:17.169747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:17.170430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:17.170881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:17.175236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:17.323408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:17.331417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c5d3cbb-385e-4596-b0e0-048c5f0ad683 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.173715 Oct 19 22:03:17.331979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 125/225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:17 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:18.020393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:18.021019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:18.027270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:18.030042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:18.030042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:18.030042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:18.030042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:18.030406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:18.090041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:18.101060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-59193644-876f-419b-b70a-70d72a6623ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1215 microversion: 2.1 time: 0.084498 Oct 19 22:03:18.101882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 101/226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:18 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:18.353548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:18.354185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:18.360209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:18.360692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:18.361124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:18.361809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:18.362384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:18.362789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:18.544607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:18.552056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-99e4eb6c-4c82-4396-934c-5411c1984a14 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.202332 Oct 19 22:03:18.552616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 126/227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:18 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:19.125195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:19.126052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:19.132586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:19.136825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:19.136825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:19.136825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:19.136825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:19.137346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:19.200494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:19.208641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c67fab1f-23ec-4d87-9e02-35b76d9d3d5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1215 microversion: 2.1 time: 0.088300 Oct 19 22:03:19.209454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 102/228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:19 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:19.575066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:19.575512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:19.581296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:19.581778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:19.582212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:19.582904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:19.583389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:19.583860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:19.738668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:19.747445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cd8461c4-1af0-4516-b592-fb8738f0486d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.176795 Oct 19 22:03:19.748181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 127/229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:19 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:20.231385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:20.231990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:20.238292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:20.238769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:20.239248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:20.239927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:20.240387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:20.241393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:20.311968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:20.321844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-98d54b1a-a7ee-4b43-b689-3c9d457201de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1215 microversion: 2.1 time: 0.094143 Oct 19 22:03:20.322489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 103/230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:20 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:20.771383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:20.774140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:20.778827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:20.779356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:20.779787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:20.780468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:20.780911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:20.781324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:20.785543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:20.916149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:20.923755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ebfa37e-1229-489d-8a30-07b86af3bcae tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.156644 Oct 19 22:03:20.924321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 128/231] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:20 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:21.346282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:21.347817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:21.355244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:21.355743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:21.358171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:21.362424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:21.363090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:21.363557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:21.446929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:21.457898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-81e3390a-a56d-4895-a492-f8ecf73db8b1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1271 microversion: 2.1 time: 0.116549 Oct 19 22:03:21.458588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 104/232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:21 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:21.946413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:21.948810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:21.953670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:21.954147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:21.954661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:21.955367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:21.955812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:21.956229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:22.088738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:22.096585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-47158aab-0ece-46d8-8038-c60119610b98 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.154069 Oct 19 22:03:22.097144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 129/233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:21 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:22.400045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:22.401239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:22.404388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:22.405225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=6 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:22.409383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:22.409869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:22.410305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:22.411058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:22.411512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:22.411962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:22.441823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:03:22.484746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:22.485424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:22.492006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:22.492480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:22.492904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:22.493590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:22.494035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:22.494444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:22.617257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:22.624779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-313aa972-b1b1-46af-9818-e4a98490d883 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1279 microversion: 2.1 time: 0.143886 Oct 19 22:03:22.625345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 130/234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:22 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:22.854297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17057c52-4162-4f5a-954b-7aa2867724ce tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 204 len: 0 microversion: 2.1 time: 0.458368 Oct 19 22:03:22.855001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 105/235] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:03:22 2022] DELETE /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:03:22.863183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:22.863798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:22.870338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:22.870827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:22.871287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:22.872169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:22.872625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:22.873048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:23.117561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:23.125912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:23.126644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:23.127486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c04d6afb-dda1-427f-ab70-cfc4040c45e4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1554 microversion: 2.1 time: 0.268182 Oct 19 22:03:23.128072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 131/236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:22 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1554 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:23.133714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:23.134206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:23.134679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:23.135960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:23.136502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:23.136891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:23.269591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:23.278359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-06b7fae1-7309-46ed-b4a6-ca3dffd9dca2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.157108 Oct 19 22:03:23.279162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 106/237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:23 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:23.651373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:23.652003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:23.653941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:23.658671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:23.664868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:23.664868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:23.664868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:23.664868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:23.665184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:23.811518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:23.818971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-181f9365-f207-40d6-9f58-915eb0e7306f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.171469 Oct 19 22:03:23.819523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 132/238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:23 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:24.151582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:24.152227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:24.158601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:24.159176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:24.159614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:24.160310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:24.160793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:24.161228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:24.290801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:24.302000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4a98fa9-da92-4342-941d-4b3e2cae000e tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1554 microversion: 2.1 time: 0.155128 Oct 19 22:03:24.305894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:24.306517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 107/239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:24 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:24.306605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:24.309657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:24.310145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:24.310573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:24.311300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:24.311928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:24.312345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:24.443984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:24.452268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e4890fe7-81d7-471a-a47b-c0f8a98303de tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.154164 Oct 19 22:03:24.452991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 133/240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:24 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:24.846318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:24.847446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:24.857058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:24.857985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:24.860239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:24.861360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:24.862017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:24.863349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:24.869424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:25.163749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:25.172097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e905526-8450-42aa-ba41-a8231852e0b7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.334348 Oct 19 22:03:25.172943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 108/241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:24 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:25.328749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:25.330163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:25.337161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:25.338907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:25.342485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:25.342485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:25.342485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:25.342485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:25.479830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:25.480625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:25.487555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:25.487555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:25.487982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:25.488664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:25.489938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:25.490526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:25.637459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:25.644838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b394d556-a657-4402-b579-6f948dd25ad3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.168451 Oct 19 22:03:25.645050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 109/242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:25 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:25.723550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:25.734556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2421b47-f926-4c2e-b52a-74ceaddb0305 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1554 microversion: 2.1 time: 0.410828 Oct 19 22:03:25.735443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 134/243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:25 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1554 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:26.030531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-2b6a9843-2720-475a-a796-d5aa0dc8074b req-8bae700c-63d9-463b-b563-9c0ac0ea9303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bcf0c7b-b225-403e-bba5-f37638c3c75e", "tag": "e4aea8d2-d7a3-4d23-be2e-059743619d11"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:26.040258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-2b6a9843-2720-475a-a796-d5aa0dc8074b req-8bae700c-63d9-463b-b563-9c0ac0ea9303 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:26.040732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-2b6a9843-2720-475a-a796-d5aa0dc8074b req-8bae700c-63d9-463b-b563-9c0ac0ea9303 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:26.041937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-2b6a9843-2720-475a-a796-d5aa0dc8074b req-8bae700c-63d9-463b-b563-9c0ac0ea9303 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:26.054617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-2b6a9843-2720-475a-a796-d5aa0dc8074b req-8bae700c-63d9-463b-b563-9c0ac0ea9303 service nova] Creating event network-changed:e4aea8d2-d7a3-4d23-be2e-059743619d11 for instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e on hv-cinder-maste Oct 19 22:03:26.061839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-2b6a9843-2720-475a-a796-d5aa0dc8074b req-8bae700c-63d9-463b-b563-9c0ac0ea9303 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035089 Oct 19 22:03:26.062815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 110/244] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:26.194843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:26.195534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:26.201643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:26.202124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:26.202554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:26.203278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:26.203731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:26.204146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:26.472780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:26.481685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f73ad798-8118-40df-b5a5-bc5cf82c47ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.290700 Oct 19 22:03:26.496869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 135/245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:26 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:26.679720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:26.682731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:26.692503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:26.692995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:26.693427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:26.694289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:26.697670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:26.697670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:26.764921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:26.765933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:26.775376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:26.776844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:26.777365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:26.778384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:26.779040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:26.779435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:26.909266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:26.919503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78a06777-fa58-41c2-a94d-625d97d0a94b tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1512 microversion: 2.1 time: 0.162992 Oct 19 22:03:26.921696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 136/246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:26 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:26.967220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:26.977496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0a306d4d-bcca-410a-9c79-c6a0414a73e6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.307880 Oct 19 22:03:26.978470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 111/247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:26 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:27.504504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:27.505106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:27.511930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:27.512412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:27.512839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:27.513568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:27.514040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:27.514453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:27.647976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:27.656385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8df0179-d71f-4c8e-8b81-353373ef7eb9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.155642 Oct 19 22:03:27.657037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 137/248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:27 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:27.943674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:27.944282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:27.951791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:27.952287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:27.952725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:27.953426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:27.953880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:27.954349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:27.985649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:27.986136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:27.986571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:27.987044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lazy-loading 'fault' on Instance uuid a2005ac4-9f7f-4daa-86e1-0e29a3167663 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:03:28.002149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:28.012117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:28.019866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:28.020465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:28.021172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:28.021942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:28.022470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:28.022971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:28.044532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:28.054423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e130075d-257e-4a46-b460-91b008317a55 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1351 microversion: 2.1 time: 0.114566 Oct 19 22:03:28.055029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 112/249] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:27 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:28.103390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-eaa2e58b-bf4c-4114-9424-290bae4c56ce req-cb1a324c-92a6-487c-b697-4a77137c2aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2005ac4-9f7f-4daa-86e1-0e29a3167663", "name": "network-vif-deleted", "tag": "da3df6f6-a999-415a-ad65-de5c162c6cf1"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:28.115462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-eaa2e58b-bf4c-4114-9424-290bae4c56ce req-cb1a324c-92a6-487c-b697-4a77137c2aaf service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:28.116149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-eaa2e58b-bf4c-4114-9424-290bae4c56ce req-cb1a324c-92a6-487c-b697-4a77137c2aaf service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:28.116662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-eaa2e58b-bf4c-4114-9424-290bae4c56ce req-cb1a324c-92a6-487c-b697-4a77137c2aaf service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:28.132546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-eaa2e58b-bf4c-4114-9424-290bae4c56ce req-cb1a324c-92a6-487c-b697-4a77137c2aaf service nova] Creating event network-vif-deleted:da3df6f6-a999-415a-ad65-de5c162c6cf1 for instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 on hv-cinder-maste Oct 19 22:03:28.138041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-eaa2e58b-bf4c-4114-9424-290bae4c56ce req-cb1a324c-92a6-487c-b697-4a77137c2aaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039363 Oct 19 22:03:28.139063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 113/250] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:03:28.174531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:28.184299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9f2bb2c8-303e-4cb4-b1a5-9d327dc0388b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.186683 Oct 19 22:03:28.198907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 138/251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:27 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:28.680388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:28.681093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:28.688613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:28.689231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:28.689886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:28.690604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:28.691089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:28.691832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:28.850033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:28.858618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1f01360e-2f27-46fa-85fb-34a9e79e9afc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.182878 Oct 19 22:03:28.859998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 114/252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:28 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:29.078481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:29.079583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:29.086333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:29.087118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:29.087713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:29.088448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:29.088903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:29.089326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:29.124380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:29.125052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:29.125487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:29.125942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lazy-loading 'fault' on Instance uuid a2005ac4-9f7f-4daa-86e1-0e29a3167663 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:03:29.170542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53639656d3a542c0b822ea8084b2e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e2ff128466409e98277d6e1c620fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:29.178918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b7f710dd-3cb2-450f-88fd-c16f7337ebeb tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 200 len: 1351 microversion: 2.1 time: 0.105122 Oct 19 22:03:29.179494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 139/253] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:29 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:29.207619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:29.208224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:29.214738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:29.215258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:29.215688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:29.216380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:29.216830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:29.217299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:29.386913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:29.396116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ddd94ea3-e9fb-4c8c-826d-20c259691929 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.192312 Oct 19 22:03:29.396738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 115/254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:29 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:29.881608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:29.882223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:29.889103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:29.889516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:29.889955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:29.890654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:29.891192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:29.891624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:30.036128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:30.044353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fee39433-0b6f-40d1-af80-b9b4dafcbd5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.166549 Oct 19 22:03:30.045075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 140/255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:29 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:30.202271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:30.202881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:30.208822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:30.209445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:30.209744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:30.210428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:30.211071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:30.211720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:30.227862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] HTTP exception thrown: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Request method failure captured: Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 HTTP/1.1 Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPnOEE4LFGS6y8gq9eZum5qmP8VvVi2ww9aYgfrVpImZXKarCRXM0zepaL2YKn_pNKZWz6-TOqlkvAChPjk1UtNaBVNvcEbv1yii7Ywgn1Tb-apGSXsaZtQuwIeVb2_sCYmiE5rjN8bTIs0uQPsF_Lo3fVEa-4LoNeD-hyW7DIxXS0 Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:03:30.233092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95e2ff128466409e98277d6e1c620fca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}] Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 53639656d3a542c0b822ea8084b2e2d5 Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.234549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'a2005ac4-9f7f-4daa-86e1-0e29a3167663'} Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:03:30.238323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.239638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.241271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Returning 404 to user: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:03:30.241271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-09f2d71a-476b-4a35-b5e9-7394d4661445 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 404 len: 111 microversion: 2.1 time: 0.036806 Oct 19 22:03:30.241271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 116/256] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:30 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:03:30.359155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:30.361630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:30.367742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:30.368271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:30.368702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:30.369895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:30.370398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:30.370765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:30.384448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] HTTP exception thrown: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Request method failure captured: Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663/os-volume_attachments HTTP/1.1 Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPnOEE4LFGS6y8gq9eZum5qmP8VvVi2ww9aYgfrVpImZXKarCRXM0zepaL2YKn_pNKZWz6-TOqlkvAChPjk1UtNaBVNvcEbv1yii7Ywgn1Tb-apGSXsaZtQuwIeVb2_sCYmiE5rjN8bTIs0uQPsF_Lo3fVEa-4LoNeD-hyW7DIxXS0 Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:03:30.389329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95e2ff128466409e98277d6e1c620fca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}] Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 53639656d3a542c0b822ea8084b2e2d5 Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.392116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'server_id': 'a2005ac4-9f7f-4daa-86e1-0e29a3167663'} Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:03:30.392740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:30.393755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:30.394840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Returning 404 to user: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:03:30.394840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-012079d4-614c-4071-a323-19d3fe1ffcc4 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035761 Oct 19 22:03:30.394840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 141/257] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:03:30 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:03:30.419601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:30.420323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:30.426387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:30.427041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:30.427544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:30.428587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:30.429102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:30.429593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:30.703785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:30.711994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e980204-8082-4342-8cb5-719fe28113ca tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.296400 Oct 19 22:03:30.712709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 117/258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:30 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:31.069008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:31.069630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:31.089852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:31.090342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:31.090699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:31.093787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:31.093787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:31.093787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:31.247529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:31.255747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-84739fef-5b4b-407b-8ddc-2d3e82735891 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.191584 Oct 19 22:03:31.256589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 142/259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:31 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:31.734098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:31.737457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:31.741233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:31.741720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:31.742153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:31.742837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:31.743329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:31.743746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:31.896767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:31.905038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c173d004-c9fe-4661-82c7-73bd70aae84c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.174708 Oct 19 22:03:31.905814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 118/260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:31 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:31.992935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:31.992935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:31.995167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:31.995819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:31.996265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:31.996966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:31.997479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:31.997904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:32.022883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] HTTP exception thrown: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Request method failure captured: Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: DELETE /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 HTTP/1.1 Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPnOEE4LFGS6y8gq9eZum5qmP8VvVi2ww9aYgfrVpImZXKarCRXM0zepaL2YKn_pNKZWz6-TOqlkvAChPjk1UtNaBVNvcEbv1yii7Ywgn1Tb-apGSXsaZtQuwIeVb2_sCYmiE5rjN8bTIs0uQPsF_Lo3fVEa-4LoNeD-hyW7DIxXS0 Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:03:32.026463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95e2ff128466409e98277d6e1c620fca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}] Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 53639656d3a542c0b822ea8084b2e2d5 Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.033769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': 'a2005ac4-9f7f-4daa-86e1-0e29a3167663'} Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:03:32.034618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.035676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.036901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Returning 404 to user: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:03:32.036901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-92ffbab5-8ca4-45d9-a0bf-74dc06454a37 tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 404 len: 111 microversion: 2.1 time: 0.047858 Oct 19 22:03:32.036901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 143/261] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:03:31 2022] DELETE /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:03:32.039912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:32.040586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] [instance: a2005ac4-9f7f-4daa-86e1-0e29a3167663] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:32.047325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:32.047816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:32.048260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:32.049228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:32.050864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:32.051697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:32.067916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] HTTP exception thrown: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Request method failure captured: Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 HTTP/1.1 Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPnOEE4LFGS6y8gq9eZum5qmP8VvVi2ww9aYgfrVpImZXKarCRXM0zepaL2YKn_pNKZWz6-TOqlkvAChPjk1UtNaBVNvcEbv1yii7Ywgn1Tb-apGSXsaZtQuwIeVb2_sCYmiE5rjN8bTIs0uQPsF_Lo3fVEa-4LoNeD-hyW7DIxXS0 Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:03:32.069719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95e2ff128466409e98277d6e1c620fca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95e2ff128466409e98277d6e1c620fca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95e2ff128466409e98277d6e1c620fca"}]}] Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 95e2ff128466409e98277d6e1c620fca Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-DeleteServersTestJSON-167496622 Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 53639656d3a542c0b822ea8084b2e2d5 Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-DeleteServersTestJSON-167496622-project Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.070855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'a2005ac4-9f7f-4daa-86e1-0e29a3167663'} Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:03:32.071520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. Oct 19 22:03:32.072580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:03:32.076374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] Returning 404 to user: Instance a2005ac4-9f7f-4daa-86e1-0e29a3167663 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:03:32.077494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-34df577a-db5d-4056-bf1d-06ced7ae594f tempest-DeleteServersTestJSON-167496622 tempest-DeleteServersTestJSON-167496622-project] 10.222.0.20 "GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663" status: 404 len: 111 microversion: 2.1 time: 0.041629 Oct 19 22:03:32.082172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 119/262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:32 2022] GET /compute/v2.1/servers/a2005ac4-9f7f-4daa-86e1-0e29a3167663 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:03:32.280594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:32.281212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:32.287368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:32.287856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:32.288288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:32.288978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:32.289427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:32.289844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:32.487313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:32.495746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b06c1180-756b-44fc-883e-4c724d5a78da tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.220497 Oct 19 22:03:32.496508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 144/263] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:32 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:32.929905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:32.931257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:32.950398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:32.950890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:32.951343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:32.952045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:32.952499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:32.952914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:33.245694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:33.253812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e4f10fad-2fca-453c-b598-60c38cedb8c4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.329206 Oct 19 22:03:33.254760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 120/264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:32 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:33.524220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:33.524831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:33.532596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:33.533141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:33.533906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:33.534617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:33.535171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:33.540284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:33.685004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:33.694300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:33.701120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-25d075fb-5007-4796-994f-0ad903b8d501 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.180639 Oct 19 22:03:33.703224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 145/265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:33 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:33.863999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-811b8489-edc2-42ee-b54a-7e6faf917b4c req-c1f2cbd4-feba-4b07-9057-7de3d7f4050d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcf0c7b-b225-403e-bba5-f37638c3c75e", "name": "network-vif-plugged", "status": "completed", "tag": "e4aea8d2-d7a3-4d23-be2e-059743619d11"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:33.875665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:33.884453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-811b8489-edc2-42ee-b54a-7e6faf917b4c req-c1f2cbd4-feba-4b07-9057-7de3d7f4050d service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:33.885854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-811b8489-edc2-42ee-b54a-7e6faf917b4c req-c1f2cbd4-feba-4b07-9057-7de3d7f4050d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:33.886921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-811b8489-edc2-42ee-b54a-7e6faf917b4c req-c1f2cbd4-feba-4b07-9057-7de3d7f4050d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:33.910813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-811b8489-edc2-42ee-b54a-7e6faf917b4c req-c1f2cbd4-feba-4b07-9057-7de3d7f4050d service nova] Creating event network-vif-plugged:e4aea8d2-d7a3-4d23-be2e-059743619d11 for instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e on hv-cinder-maste Oct 19 22:03:33.917012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-811b8489-edc2-42ee-b54a-7e6faf917b4c req-c1f2cbd4-feba-4b07-9057-7de3d7f4050d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057875 Oct 19 22:03:33.924244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 121/266] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:34.285346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:34.290201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:34.312885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=93 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:34.318136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:34.318602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:34.319158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:34.324303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:34.324841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:34.326611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:34.623952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:34.638018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5194c802-2646-4b0b-87e0-f99813590671 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.363588 Oct 19 22:03:34.640376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 146/267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:34 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:34.729593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:34.730483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:34.738833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:34.739356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:34.739824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:34.741361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:34.741361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:34.741624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:35.082173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:35.082173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3d68b1e5-b959-41d7-b434-24af1fab90cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.221114 Oct 19 22:03:35.082173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 122/268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:34 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:35.662812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:35.663487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:35.670598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:35.671162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:35.677216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:35.677216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:35.677216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:35.677216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:35.813578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:35.821526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c017a37d-4afb-46e3-86db-d5368275db44 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.162544 Oct 19 22:03:35.822085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 147/269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:35 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:36.094015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:36.094652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:36.101060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:36.101599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:36.102035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:36.102723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:36.103215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:36.104150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:36.279544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:36.293216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8d8180f2-4e19-43f7-a30c-a52591a4331d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.203321 Oct 19 22:03:36.296429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 123/270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:36 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:36.844679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:36.845750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:36.851459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:36.851938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:36.852366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:36.853051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:36.853498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:36.853909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:36.999184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:37.007037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0b34fde9-61d7-4864-b065-dbd7e0160b73 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.166080 Oct 19 22:03:37.007718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 148/271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:36 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:37.344496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:37.345869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:37.353975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:37.354754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:37.355469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:37.356364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:37.356903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:37.357403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:37.519739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:37.532083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-12ada13c-8a9e-4fd4-beb7-99b9bdc606f3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.219254 Oct 19 22:03:37.533758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 124/272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:37 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:38.031920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:38.032483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:38.038478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:38.038979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:38.039454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:38.040179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:38.040623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:38.041078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:38.170158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:38.177856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b0464f50-2c37-4561-96dd-26085df2e1d4 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.150048 Oct 19 22:03:38.178674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 149/273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:38 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:38.556403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:38.557549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:38.563891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:38.565543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:38.565543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:38.565543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:38.565965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:38.566398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:38.711965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:38.721308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9b267abd-94f1-4fec-87e7-a66f0c92a507 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1319 microversion: 2.1 time: 0.168047 Oct 19 22:03:38.721308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 125/274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:38 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:39.201077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:39.201722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:39.215135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:39.215826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:39.216259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:39.217173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:39.217627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:39.218047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:39.374341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:39.382495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-53312437-5f33-4b2d-89d8-6d0419576886 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.185717 Oct 19 22:03:39.383077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 150/275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:39 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:39.743235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:39.745261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:39.752428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:39.753280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:39.753888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:39.754763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:39.755395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:39.755971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:39.954703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:39.962444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8a56d9d2-4e34-4337-81f0-7865f311e61e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1508 microversion: 2.1 time: 0.223403 Oct 19 22:03:39.963749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 126/276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:39 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:40.405404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:40.406129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:40.412067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:40.412543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:40.412969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:40.413648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:40.414097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:40.414513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:40.546998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:40.555245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6371845a-c210-43f8-a11b-792346336091 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.153597 Oct 19 22:03:40.556122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 151/277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:40 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:41.579995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:41.580616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:41.589761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:41.590605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:41.591390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:41.592260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:41.592868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:41.593479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:41.831006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:41.837194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:41.856254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b8533c52-d5af-47b1-846d-1e4f86f620fc tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.282177 Oct 19 22:03:41.858738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 127/278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:41 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:42.879426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:42.882505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:42.886627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:42.887219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:42.887903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:42.888764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:42.889313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:42.889866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:43.095296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:43.113840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-992602a7-aeb7-4076-8618-8581c3a63b18 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.238069 Oct 19 22:03:43.114822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 152/279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:42 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:44.141505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:44.143064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:44.156357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:44.157408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:44.158014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:44.158912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:44.160222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:44.163627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:44.371671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:44.379868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6f9bd11f-a9d3-416c-8247-2275aa7421f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.245350 Oct 19 22:03:44.382856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 128/280] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:44 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:45.405198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:45.406181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:45.418752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:45.432354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:45.432816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:45.433557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:45.434026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:45.438661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:45.728985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:45.744428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-787487f9-8602-45f6-acd5-0c25f007fbcf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.343744 Oct 19 22:03:45.745728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 153/281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:45 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:45.963407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-87c49581-1ab6-4643-b28f-5c3a5c5dbb2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'create', calling method: .version_select at 0x7f73331a89d0>, body: {"keypair": {"name": "tempest-keypair-1323590936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJErqC+6nzEY/8PoYGLladFsuE399rWrgmJAS27W+iar9HbLeWzO5cVKvE/Siw4Effp4GHgoMRqky53RUffjyiY2wqgwcarqK5T4ONOoXV+Z+uxJpY92n+yDEUVHhux1A=="}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:45.989817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-87c49581-1ab6-4643-b28f-5c3a5c5dbb2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:03:46.001310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-87c49581-1ab6-4643-b28f-5c3a5c5dbb2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for user 5ae13baf5df84b588fa65e8dffec4bbf and project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:03:46.107723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-87c49581-1ab6-4643-b28f-5c3a5c5dbb2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.552233 Oct 19 22:03:46.108991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 129/282] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:03:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:46.770710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:46.771451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:46.777781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:46.778828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:46.779295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:46.779997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:46.780484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:46.780865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:47.051746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:47.055411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-23f5db3a-d343-4ef8-b789-59aac84f17b0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.288839 Oct 19 22:03:47.055996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 154/283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:46 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:48.080936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:48.082142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:48.090418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:48.091317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:48.091858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:48.092555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:48.093009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:48.093435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:48.277633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:48.285679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f56ad7b1-890d-409f-8f19-3844c99a9304 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.210022 Oct 19 22:03:48.297983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 130/284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:48 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:48.896257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-591147290", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34d02d4f-94c3-4c75-9a63-86e5b6f3edc9"}], "security_groups": [{"name": "tempest-securitygroup--152256954"}], "key_name": "tempest-keypair-1323590936", "user_data": "}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:49.043985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] validate_networks() for [('34d02d4f-94c3-4c75-9a63-86e5b6f3edc9', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:03:49.309137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:49.314816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:49.317011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:49.317846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:49.318455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:49.319211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:49.319736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:49.320356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:49.592969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:49.606278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e8c403e6-e898-4fdd-95bc-23fc39e164ce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.301162 Oct 19 22:03:49.607657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 131/285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:49 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:49.839803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:03:49.840233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:03:49.840707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:03:49.841116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:03:49.841525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:03:49.862022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:49.862683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:49.863431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:49.864341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:49.865187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:49.865967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:49.889968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:03:49.894557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for user 5ae13baf5df84b588fa65e8dffec4bbf and project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:03:49.906325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:03:49.908883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:03:50.116485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b1d683b0-64d6-402f-b341-e7f63a710606 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.224486 Oct 19 22:03:50.117135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 155/286] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:03:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:03:50.130522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-75760c11-9863-43b9-884c-2b129cf3e1eb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:50.131157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-75760c11-9863-43b9-884c-2b129cf3e1eb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:50.193327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-75760c11-9863-43b9-884c-2b129cf3e1eb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:50.209109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-75760c11-9863-43b9-884c-2b129cf3e1eb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1237 microversion: 2.1 time: 0.083785 Oct 19 22:03:50.209699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 132/287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:50.638212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:50.638744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:50.646279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:50.646784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:50.647248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:50.647956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:50.648409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:50.648830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:50.785000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:50.793102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-802ef909-ef0c-439d-ae86-9757e7583c8b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.158691 Oct 19 22:03:50.793776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 156/288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:50 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:51.232870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bd104af3-2d6d-44b9-b2df-422ad7878aed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:51.233715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bd104af3-2d6d-44b9-b2df-422ad7878aed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:51.294363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bd104af3-2d6d-44b9-b2df-422ad7878aed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:51.299307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bd104af3-2d6d-44b9-b2df-422ad7878aed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1237 microversion: 2.1 time: 0.071201 Oct 19 22:03:51.299875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 133/289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:51.816536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:51.817242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:51.823885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:51.828803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:51.829498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:51.838897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:51.839505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:51.840010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:51.979640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:51.987601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-25d801cf-e31f-4fab-b2af-33fdcc7d0cb7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.175420 Oct 19 22:03:51.988108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 157/290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:51 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:52.321920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:52.322524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:52.329279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:52.329767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:52.330203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:52.330901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:52.331385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:52.331812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:52.403090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:52.411899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d6a857f-227c-4ab4-acbc-1fbf1eb0f45a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1289 microversion: 2.1 time: 0.092933 Oct 19 22:03:52.411899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 134/291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:53.012274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:53.012904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:53.018936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:53.019448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:53.019882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:53.020568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:53.021019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:53.021439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:53.161812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:53.169478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69378189-0dc3-4f8e-a84b-d41f79362e90 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.161675 Oct 19 22:03:53.170034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 158/292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:53 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:53.434516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:53.435155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:53.442884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:53.443604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:53.444231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:53.445421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:53.446217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:53.463216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:53.559210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:53.564099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6d57e47-cbe2-48b0-a069-578a47bd541c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1289 microversion: 2.1 time: 0.134080 Oct 19 22:03:53.564665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 135/293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1289 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:54.192073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:54.192679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:54.198595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:54.199118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:54.199549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:54.200232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:54.200682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:54.201105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:54.335453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:54.343695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-13a62a59-e32d-4d55-9135-f9c9210878a0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.155420 Oct 19 22:03:54.344257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 159/294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:54 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:54.588358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:54.588948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:54.595309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:54.595788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:54.596219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:54.596898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:54.598286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:54.598830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:54.659631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:54.667613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fb5a591d-34d1-4b95-a5d4-49036a0a5671 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1289 microversion: 2.1 time: 0.084423 Oct 19 22:03:54.668172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 136/295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:55.368120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:55.368890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:55.375297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:55.375966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:55.376529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:55.377335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:55.377787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:55.378202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:55.516161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:55.523947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1a4aa96d-3a75-4f28-84e8-33c4b2b082a5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1521 microversion: 2.1 time: 0.159760 Oct 19 22:03:55.524504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 160/296] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:55 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:55.690203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:55.691527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:55.700122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:55.700888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:55.701563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:55.702712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:55.703394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:55.703982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:55.798189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:55.807430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ee5f8779-a648-4019-b17a-2bf72a7f7229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1297 microversion: 2.1 time: 0.121172 Oct 19 22:03:55.808186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 137/297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:56.547492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:56.548668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:56.556450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:56.557213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:56.557867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:56.558783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:56.559491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:56.560186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:56.759880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:56.768067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-368f2dd3-2d41-4685-9c0c-e8a046abf32a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1501 microversion: 2.1 time: 0.224342 Oct 19 22:03:56.770648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 161/298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:56 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:56.797617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:56.799514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:56.809373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:56.809863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:56.811018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:56.812507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:56.812972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:56.813434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:56.831675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:56.832720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:56.839546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:56.840035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:56.840471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:56.841199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:56.841951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:56.842377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:56.986570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:56.998454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3bfaadbe-eeda-4bb0-a177-b9849fe3587d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1515 microversion: 2.1 time: 0.202328 Oct 19 22:03:56.998454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 138/299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:56 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:57.057627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:57.065986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5a3feb0b-8c22-4ce6-b1ae-385e423e4b2b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.238469 Oct 19 22:03:57.067071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 162/300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:03:57.635326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-777bbee7-431b-4f53-b214-7387419ccd2e req-d85a5164-5fc8-40e8-a9e3-2dff21f7aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fefc135-201b-453b-a232-37a012534b45", "tag": "ece9340a-fd6d-4013-9113-fde159205255"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:57.646668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-777bbee7-431b-4f53-b214-7387419ccd2e req-d85a5164-5fc8-40e8-a9e3-2dff21f7aa06 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:57.647585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-777bbee7-431b-4f53-b214-7387419ccd2e req-d85a5164-5fc8-40e8-a9e3-2dff21f7aa06 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:57.648251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-777bbee7-431b-4f53-b214-7387419ccd2e req-d85a5164-5fc8-40e8-a9e3-2dff21f7aa06 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:57.663089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-777bbee7-431b-4f53-b214-7387419ccd2e req-d85a5164-5fc8-40e8-a9e3-2dff21f7aa06 service nova] Creating event network-changed:ece9340a-fd6d-4013-9113-fde159205255 for instance 8fefc135-201b-453b-a232-37a012534b45 on hv-cinder-maste Oct 19 22:03:57.669460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-777bbee7-431b-4f53-b214-7387419ccd2e req-d85a5164-5fc8-40e8-a9e3-2dff21f7aa06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045495 Oct 19 22:03:57.670354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 139/301] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:03:58.095246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:58.096743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:58.104115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:58.104667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:58.105096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:58.105930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:58.106541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:58.106966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:58.111295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:03:58.349702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:58.357240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-533af90b-de48-4daf-9757-cb0a02de11c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.267047 Oct 19 22:03:58.357802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 163/302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:58.876940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:58.879480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:58.886362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:58.886849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:58.887309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:58.888126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:58.888580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:58.889000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:58.912142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lazy-loading 'flavor' on Instance uuid 91bd34e5-1035-4544-b76f-e925310a40cd {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:03:59.160181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2cebf779-a371-4d66-8c3c-a52eee34c52b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd/action" status: 200 len: 32 microversion: 2.1 time: 0.287744 Oct 19 22:03:59.165786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 140/303] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:03:58 2022] POST /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd/action => generated 32 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 22:03:59.171683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:59.172370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:59.174382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3087d69a-3584-4f6d-9fff-3c272d7cf817", "device": "/dev/sdb"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:03:59.177599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:59.179204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:59.179715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:59.183994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:59.183994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:59.183994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:59.183994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:59.185251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:59.185741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:59.186176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:59.186895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:59.187384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:59.187960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:59.356157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:59.363992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a956299e-88b0-4802-a1f0-95c8605059d1 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.197005 Oct 19 22:03:59.364567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 164/304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:59 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:03:59.381041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:03:59.381828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:03:59.388923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:59.389719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:59.390480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:59.391213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:03:59.391662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:03:59.392077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:03:59.530685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:03:59.538526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e5f4e454-bb4c-4803-b4c0-07f8d0b622e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.162221 Oct 19 22:03:59.539115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 165/305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:03:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:00.387728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:00.388458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:00.390286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:00.392151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=6 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:00.397326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:00.397815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:00.398248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:00.399118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:00.399618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:00.400041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:00.420148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-849cd695-0016-4e7c-92d5-f53a7db782a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "POST /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.248707 Oct 19 22:04:00.420148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 141/306] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:03:59 2022] POST /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e/os-volume_attachments => generated 194 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:00.565575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:00.566531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:00.574625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:00.575912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:00.576484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:00.577394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:00.577741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:00.578172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:00.578763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:00.587450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9dda2123-abe2-48e3-ad36-99f17e30869b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.203817 Oct 19 22:04:00.591275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 166/307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:00 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:00.717315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:00.729626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bc70b1d6-d1bc-4ea2-9e51-452299a088e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.169987 Oct 19 22:04:00.730784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 142/308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:01.610602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:01.611246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:01.618027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:01.618697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:01.619332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:01.620374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:01.620982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:01.621566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:01.727220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:01.728143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:01.744391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=8 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:01.751519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:01.752243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:01.753000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:01.753881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:01.754487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:01.755097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:01.777158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:01.780640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-407e7066-a630-4e37-a8d4-02698dd89538 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/ips" status: 200 len: 152 microversion: 2.20 time: 0.057499 Oct 19 22:04:01.781228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 143/309] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Oct 19 22:04:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/ips => generated 152 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:04:01.790771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cfabd8ac-8535-408e-9157-03dfec47fab5 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.183862 Oct 19 22:04:01.791779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 167/310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:01 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:01.795009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:01.795880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:01.802351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:01.803382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:01.804021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:01.804911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:01.805594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:01.806630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:01.939701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:01.953558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ffe3880b-43e8-4f91-a3a2-ad316eb186ae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.166116 Oct 19 22:04:01.953558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 144/311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:02.814029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:02.814641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:02.820552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:02.821037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:02.822018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:02.822705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:02.823190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:02.823616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:02.962627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:02.971744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:02.972336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:02.972912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f4825ce-1f04-4281-8a60-86236a890dd3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.161673 Oct 19 22:04:02.974165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 168/312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:02 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:02.981730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:02.983520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:02.983520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:02.985431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:02.986817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:02.988052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:02.993568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:03.125258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:03.132747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3d03262b-5326-43d7-aefa-b4c442d31062 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.165220 Oct 19 22:04:03.133307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 145/313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:03.758553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-3b006b35-c5a6-42df-80e1-d607f7c09a2e req-1b3e580a-b587-4936-b15a-21085de4f2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fefc135-201b-453b-a232-37a012534b45", "name": "network-vif-plugged", "status": "completed", "tag": "ece9340a-fd6d-4013-9113-fde159205255"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:03.768280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3b006b35-c5a6-42df-80e1-d607f7c09a2e req-1b3e580a-b587-4936-b15a-21085de4f2af service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:03.768766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3b006b35-c5a6-42df-80e1-d607f7c09a2e req-1b3e580a-b587-4936-b15a-21085de4f2af service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:03.769178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3b006b35-c5a6-42df-80e1-d607f7c09a2e req-1b3e580a-b587-4936-b15a-21085de4f2af service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:03.781569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-3b006b35-c5a6-42df-80e1-d607f7c09a2e req-1b3e580a-b587-4936-b15a-21085de4f2af service nova] Creating event network-vif-plugged:ece9340a-fd6d-4013-9113-fde159205255 for instance 8fefc135-201b-453b-a232-37a012534b45 on hv-cinder-maste Oct 19 22:04:03.787361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-3b006b35-c5a6-42df-80e1-d607f7c09a2e req-1b3e580a-b587-4936-b15a-21085de4f2af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033693 Oct 19 22:04:03.788250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 169/314] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:03.996724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:03.997320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:04.004102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:04.004587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:04.005116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:04.005804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:04.006251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:04.006671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:04.156774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:04.157988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:04.158637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:04.164653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:04.165174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:04.165861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:04.166802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:04.167607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:04.168048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3091b8d8-31c6-42e5-8eca-c986598126bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.175290 Oct 19 22:04:04.168476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:04.168624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 146/315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:03 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:04.300249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:04.308953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-56ebab85-e684-4cbb-94af-f5359c03dca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.156966 Oct 19 22:04:04.309517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 170/316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:04.740936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:04.741523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:04.747926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:04.748405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:04.748838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:04.749523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:04.749972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:04.750398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:04.772660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lazy-loading 'flavor' on Instance uuid 36e9edcd-9575-4a90-80cc-d85cdee02841 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:04:05.191360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:05.191952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:05.193908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:05.199059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:05.199550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:05.199978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:05.200663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:05.201117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:05.201525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:05.223035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8105c449-0bfd-45cd-905d-82c4c4dbe2eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/action" status: 202 len: 0 microversion: 2.20 time: 0.485653 Oct 19 22:04:05.227028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 147/317] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 19 22:04:04 2022] POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:04:05.232949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:05.234126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:05.241667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:05.242403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:05.243889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:05.245143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:05.245815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:05.246448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:05.348220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:05.356092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2b969e3-0bba-450a-86a2-b8aef70bfb63 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.168532 Oct 19 22:04:05.356649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 171/318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:05 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:05.362262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:05.363170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:05.370371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:05.371009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:05.371733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:05.372650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:05.373328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:05.373760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:05.419595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:05.430375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:05.432462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:05.433983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-28eff46e-3864-4ebd-8429-1930795bc57e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.205410 Oct 19 22:04:05.434382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 148/319] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:05.514530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:05.522124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0c392cc8-21cb-463a-aceb-29d27801bfca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1362 microversion: 2.1 time: 0.164259 Oct 19 22:04:05.522693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 172/320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:06.379786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:06.380208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:06.382293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:06.387859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.388262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.388695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.389385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.389836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.390255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.458610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:06.459231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:06.465071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.465556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.465995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.466683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.467171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.467593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.520656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:06.528832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ffc10beb-07b7-4c30-8081-d7018f8c9bb9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.153772 Oct 19 22:04:06.529431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 149/321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:06 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:06.551557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:06.552171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:06.559249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.560041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.560763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.561633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.562094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.562524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.608839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:06.617119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:06.619182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:06.620782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e3594fe3-64f1-44ab-9785-a76330f54e5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.165601 Oct 19 22:04:06.621342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 173/322] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:06.706354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:06.715082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c1be0718-310f-450e-a992-a58c132b4048 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1548 microversion: 2.1 time: 0.166427 Oct 19 22:04:06.715082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 150/323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:06.736460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:06.737058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:06.743155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.744151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.744579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.745256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:06.745756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:06.746172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:06.823466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4248b8fc-7f8d-4da6-919f-c72f21d279b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090785 Oct 19 22:04:06.824051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 174/324] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 19 22:04:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:07.551861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:07.552471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:07.559310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:07.559800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:07.560238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:07.560941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:07.561398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:07.561826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:07.645664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:07.646790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:07.653489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:07.653976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:07.654568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:07.655453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:07.656077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:07.656636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:07.700381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:07.708168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-299cd9c2-aabe-4d52-a546-8055a83da406 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.160114 Oct 19 22:04:07.708735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 151/325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:07 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:07.914229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:07.922450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:07.923960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:07.925121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0d24ed42-a9ae-4daa-ba6b-1a122867c0a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.283314 Oct 19 22:04:07.925677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 175/326] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:08.194439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-ae3b4969-6b80-4344-86a3-53dc1aeba540 req-cc74d292-b921-4afb-9c62-bce313eb68d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fefc135-201b-453b-a232-37a012534b45", "tag": "ece9340a-fd6d-4013-9113-fde159205255"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:08.203906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-ae3b4969-6b80-4344-86a3-53dc1aeba540 req-cc74d292-b921-4afb-9c62-bce313eb68d4 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:08.204581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-ae3b4969-6b80-4344-86a3-53dc1aeba540 req-cc74d292-b921-4afb-9c62-bce313eb68d4 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:08.207566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-ae3b4969-6b80-4344-86a3-53dc1aeba540 req-cc74d292-b921-4afb-9c62-bce313eb68d4 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:08.221790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-ae3b4969-6b80-4344-86a3-53dc1aeba540 req-cc74d292-b921-4afb-9c62-bce313eb68d4 service nova] Creating event network-changed:ece9340a-fd6d-4013-9113-fde159205255 for instance 8fefc135-201b-453b-a232-37a012534b45 on hv-cinder-maste Oct 19 22:04:08.228423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-ae3b4969-6b80-4344-86a3-53dc1aeba540 req-cc74d292-b921-4afb-9c62-bce313eb68d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036559 Oct 19 22:04:08.229517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 152/327] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:08.731321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:08.732028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:08.752710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:08.753289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:08.753945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:08.754845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:08.755529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:08.756137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:08.937972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:08.947197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-85ac8a9b-d012-4943-9528-2e8a4fadd1c6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.219774 Oct 19 22:04:08.947777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 176/328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:08 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:08.953807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:08.954496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:08.963376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:08.963973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:08.964840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:08.965507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:08.966071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:08.966672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:09.115167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:09.123801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:09.126351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:09.127967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-591116d0-2928-4d9d-9523-80c368c7062a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.179620 Oct 19 22:04:09.129411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 153/329] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:09.972259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:09.972861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:09.979863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:09.980346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:09.991270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:09.991270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:09.991270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:09.991270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:10.114112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:10.121890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-454a8bab-5ef7-41c3-a80b-67477c702631 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.153610 Oct 19 22:04:10.122504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 177/330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:09 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:10.154089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:10.154697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:10.161059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:10.161540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:10.161967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:10.162650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:10.163155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:10.163568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:10.222835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:10.223349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:10.229975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:10.230465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:10.230902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:10.231620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:10.232074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:10.232512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:10.265711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-47a71e25-9d93-4a28-920e-716cba57b280 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/ips" status: 200 len: 149 microversion: 2.1 time: 0.046910 Oct 19 22:04:10.266554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 178/331] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:04:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:10.325079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:10.333489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:10.335183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:10.336353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dc361a11-c5fd-47d0-b699-f985d4d723e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.186935 Oct 19 22:04:10.337480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 154/332] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:11.145027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:11.145638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:11.151792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:11.152276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:11.152706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:11.153404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:11.154081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:11.154496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:11.299458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:11.308315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6d6e77f1-c2ef-47e8-8d35-c0305749e475 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.167071 Oct 19 22:04:11.308885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 179/333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:11 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:11.363258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:11.363788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:11.371244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:11.371742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:11.372185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:11.373015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:11.373469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:11.374057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:11.506854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:11.514928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:11.516405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:11.517555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f76bc441-4988-490e-802c-9eae03937210 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.158687 Oct 19 22:04:11.518116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 155/334] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:12.338896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:12.340979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:12.349475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:12.349970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:12.354502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:12.354502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:12.354502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:12.354502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:12.505518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:12.516929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-207b7688-a1fe-41a5-bab3-a73ec78e791c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.182313 Oct 19 22:04:12.517495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 180/335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:12 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:12.543782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:12.545236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:12.552043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:12.552641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:12.553455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:12.554243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:12.554859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:12.555483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:12.687444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:12.695480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:12.697495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:12.698764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-410369ff-2500-4ad6-bf07-c3dadb187e7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.158972 Oct 19 22:04:12.699345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 156/336] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:13.096016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d739c2d-2804-4e8b-bd81-9aa938bfcec7"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:13.098681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:13.105749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:13.106236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:13.106664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:13.107384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:13.107828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:13.108324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:13.112031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:13.543127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:13.543346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:13.549677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:13.550887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:13.551364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:13.552060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:13.552506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:13.553362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:13.687640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:13.695225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-afb8bb15-a332-46b8-98f7-a8520e51b8af tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.158042 Oct 19 22:04:13.695813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 157/337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:13 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:13.724581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:13.725165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:13.731436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:13.731914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:13.732346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:13.733030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:13.733482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:13.733897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:13.875281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:13.883778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:13.885696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:13.886851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a7df6f77-8814-4fb0-b7f9-1a2081fd0cb9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.166075 Oct 19 22:04:13.887432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 158/338] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:13.976504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dd139988-0540-4594-b1d1-74693a05b58b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884213 Oct 19 22:04:13.977219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 181/339] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:04:13 2022] POST /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:14.717624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:14.718224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:14.724578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:14.725064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:14.725620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:14.726170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:14.726653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:14.727103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:14.867297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:14.875845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dc9a3264-23dd-4aee-beb6-855b8dcede08 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.162077 Oct 19 22:04:14.876408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 159/340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:14 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:14.914314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:14.915533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:14.923111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:14.923595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:14.924033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:14.924727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:14.925191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:14.926626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:15.059650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:15.068961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:15.070413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:15.071598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74b3ee1c-2f95-487e-83fe-07fe7b738923 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.162010 Oct 19 22:04:15.072317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 182/341] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:15.897637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:15.898215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:15.905348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:15.905837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:15.906282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:15.906990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:15.907453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:15.907887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:15.928627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:16.044756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:16.053790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-376efab2-d839-4e23-b2dc-34be4fdc808a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.160067 Oct 19 22:04:16.054451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 160/342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:15 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:16.162921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:16.162921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:16.162921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:16.162921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:16.164788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:16.164788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:16.164788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:16.164788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:16.246550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:16.255261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:16.256764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:16.258021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ccf3e8af-59f8-4e26-a9cb-d02d659773d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.164305 Oct 19 22:04:16.259169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 183/343] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:17.182833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:17.183538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:17.191469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:17.191469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:17.191469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:17.192368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:17.192368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:17.192690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:17.284717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:17.285393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:17.299832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:17.309032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:17.309032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:17.309032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:17.309032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:17.309383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:17.360720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:17.383152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cf96c868-5c8b-4c66-b57d-8674f4cd56ed tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.191281 Oct 19 22:04:17.383152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 161/344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:17 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:17.627475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:17.636232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:17.637670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:17.638916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7146eb79-2411-43cf-b96a-4b3fe096ef79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.359402 Oct 19 22:04:17.639440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 184/345] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:18.406131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:18.406749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:18.413088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:18.413571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:18.413999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:18.415297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:18.415806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:18.416349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:18.546705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:18.555225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-73419973-ff4e-43b2-8a9b-40614702fadf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.152937 Oct 19 22:04:18.555835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 162/346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:18 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:18.663034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:18.663548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:18.669945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:18.670430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:18.670845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:18.671550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:18.672062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:18.672483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:18.864696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:18.875026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:18.876760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:18.877924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f84f847-6a9a-4917-b349-71b53409feec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.218840 Oct 19 22:04:18.878592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 185/347] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:19.577737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:19.578634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:19.585479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:19.585965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:19.586397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:19.587138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:19.587587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:19.588128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:19.731125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:19.739731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b8d0013-f25c-41d5-8d35-3090eb16285d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.165916 Oct 19 22:04:19.754998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 163/348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:19 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:19.912264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:19.912264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:19.912899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:19.913390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:19.913882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:19.914666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:19.915658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:19.916083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:20.172294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:20.181007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:20.182417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:20.183771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2feeb992-d787-4303-aa0b-49ebc13af312 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.282694 Oct 19 22:04:20.184319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 186/349] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:20.766391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:20.767476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:20.791291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:20.792993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:20.793677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:20.794940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:20.795631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:20.796289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:21.022686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:21.030449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-13e96281-f3b4-4b9b-afef-cbce419a0f54 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.272558 Oct 19 22:04:21.031063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 164/350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:20 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:21.210244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:21.210915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:21.219217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:21.223101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:21.223101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:21.223101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:21.223101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:21.223440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:21.502318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:21.519394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:21.521854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:21.524971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-55e9c49b-c1cd-497d-a20d-3da5e8907297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.318390 Oct 19 22:04:21.531101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 187/351] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:22.054412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:22.056507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:22.074355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:22.074862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:22.076575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:22.082860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:22.083887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:22.085038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:22.240401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:22.253677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d390b4b8-e939-4972-90e8-04c999da20f3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.203841 Oct 19 22:04:22.254976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 165/352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:22 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:22.564045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:22.566568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:22.576490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:22.577355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:22.583557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:22.583557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:22.583557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:22.583557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:22.829999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:22.838548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:22.840262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:22.841506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-93d2f6a0-544a-47c8-9da8-ad450f4f7516 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.284243 Oct 19 22:04:22.842296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 188/353] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:23.277520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:23.278327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:23.285418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:23.285911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:23.286352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:23.287086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:23.287543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:23.288162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:23.525848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:23.555050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e9449311-0b25-4f53-b266-45ffc3a26079 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.278233 Oct 19 22:04:23.558516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 166/354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:23 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:23.870200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:23.873793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:23.882259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:23.901465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:23.901973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:23.902781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:23.903257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:23.903680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:24.488007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:24.498505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:24.499979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:24.501164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-88b4b0b1-9e28-4883-9660-260832ec5569 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.637677 Oct 19 22:04:24.501715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 189/355] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:24.596154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:24.597218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:24.607241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:24.608064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:24.608699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:24.609568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:24.610181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:24.610777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:24.762105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:24.770906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03339a70-86fe-46c1-80e9-ad431f00c0bd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.190748 Oct 19 22:04:24.773227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 167/356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:24 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:25.532379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:25.532951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:25.540354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:25.540943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:25.541597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:25.542318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:25.542766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:25.543474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:25.687853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:25.696360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:25.697783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:25.698936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-35a2a5f6-997d-4e41-8ce5-b93cd34beb35 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.170698 Oct 19 22:04:25.699500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 190/357] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:25.796813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:25.801906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:25.811352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:25.811849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:25.812289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:25.812999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:25.825035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:25.825035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:25.936451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e0fe646c-a6b8-4790-8911-3feca8555634 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: .version_select at 0x7f73331cb310>, body: {"keypair": {"name": "tempest-keypair-15250024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNN2OxQju1+Ulmv7pZHwyMI5h9lSDZxuCh0POcU9u49oU+8M1g+tKbfijZT4nB0665eaqQVOQ+q2J+q8zUSAYkc9rgNz2GClzIxa3LJSMLPgaCYx2ae9jqjvLlLp9q/4w=="}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:25.955595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-e0fe646c-a6b8-4790-8911-3feca8555634 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:25.960392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-e0fe646c-a6b8-4790-8911-3feca8555634 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:26.058062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:26.067911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9aea09a8-67f1-4bdc-a018-514095708eeb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.275109 Oct 19 22:04:26.068521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 168/358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:25 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:26.110850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e0fe646c-a6b8-4790-8911-3feca8555634 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.178934 Oct 19 22:04:26.111509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 191/359] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:04:25 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:04:26.190277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:26.190792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:26.197446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:26.197928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:26.198387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:26.199185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:26.199635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:26.205496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:26.367541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lazy-loading 'services' on Instance uuid 3bcf0c7b-b225-403e-bba5-f37638c3c75e {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:04:26.466315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-228848872", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "networks": [{"uuid": "68b1ada2-1ff5-48fa-9777-32447d26a222"}]}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:26.534187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] validate_networks() for [('68b1ada2-1ff5-48fa-9777-32447d26a222', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:04:26.651206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b70e3c3a-5539-4511-b119-0e4e290a7cf2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e/os-volume_attachments/3087d69a-3584-4f6d-9fff-3c272d7cf817" status: 202 len: 0 microversion: 2.1 time: 0.464408 Oct 19 22:04:26.653566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 169/360] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:04:26 2022] DELETE /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e/os-volume_attachments/3087d69a-3584-4f6d-9fff-3c272d7cf817 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:04:26.728466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:26.729570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:26.738780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:26.739562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:26.743534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:26.745561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:26.746244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:26.746818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:26.920205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:26.937446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:26.939752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:26.941832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-191564d8-6630-4812-99c4-fe4d557fbd7c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1724 microversion: 2.20 time: 0.220685 Oct 19 22:04:26.942764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 170/361] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:27.097279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:27.098342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:27.124319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.125533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.126702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.128754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.130041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.130701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.134587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:04:27.135194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:04:27.135763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:04:27.136284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:04:27.136791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:04:27.161141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.161727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.162156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.162871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.163389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.163807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.183183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Getting quotas for project bbf0f765079a44bc9e68012054763b34. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:27.188589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Getting quotas for user e92dd14e2eff4cc0a256708fba70c09d and project bbf0f765079a44bc9e68012054763b34. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:27.201149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:04:27.203817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:04:27.362920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ef83f392-9f48-4796-bfd7-db4dc01c7fe2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900298 Oct 19 22:04:27.363467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:27.369479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 192/362] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 22:04:27.382209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-007b7de6-0824-48a2-bf2b-04c871dfae6e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:27.382925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-467b40d1-d241-47d8-99c7-3a928a5b4f24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1501 microversion: 2.1 time: 0.287721 Oct 19 22:04:27.383288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-007b7de6-0824-48a2-bf2b-04c871dfae6e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:27.384053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 171/363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:27 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:27.411965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dc2608c-43f7-4ae6-bbd2-e8d37f4dc1c9"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:27.417348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:27.427145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.428430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.429157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.430137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.430826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.431504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.491332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] HTTP exception thrown: Cannot 'attach_volume' instance 91bd34e5-1035-4544-b76f-e925310a40cd while it is in vm_state rescued Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Request method failure captured: Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: POST /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd/os-volume_attachments HTTP/1.1 Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 74 Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPnMonHOKSWNkwdVcXpHfQSFB0FjPD1po2qnoc2XPqTZ2ZlTWUk8iqedAofhJc06AFi5K5cbD_e9PoiR3SITTxboMA-_1XhTQFMTl5d7Q50xMRhDzqo01Dj_dsQdk40cHPBvQXYmXfrBMYDLNWTyzyTnNSMnIGF7-UbvkDZhMpX4jU Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:04:27.504240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65cb45d314f743799145a0fc614ce83e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}] Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 2c7d8acfab1041fc8edf36fd42b06993 Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {"volumeAttachment": {"volumeId": "4dc2608c-43f7-4ae6-bbd2-e8d37f4dc1c9"}} Oct 19 22:04:27.505657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Cannot 'attach_volume' instance 91bd34e5-1035-4544-b76f-e925310a40cd while it is in vm_state rescued Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'server_id': '91bd34e5-1035-4544-b76f-e925310a40cd', 'body': {'volumeAttachment': {'volumeId': '4dc2608c-43f7-4ae6-bbd2-e8d37f4dc1c9'}}} Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91bd34e5-1035-4544-b76f-e925310a40cd in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:04:27.506398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 91bd34e5-1035-4544-b76f-e925310a40cd while it is in vm_state rescued Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:04:27.507504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:04:27.509158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:04:27.509158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:04:27.509158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 91bd34e5-1035-4544-b76f-e925310a40cd while it is in vm_state rescued Oct 19 22:04:27.509158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:27.509158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Returning 409 to user: Cannot 'attach_volume' instance 91bd34e5-1035-4544-b76f-e925310a40cd while it is in vm_state rescued {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:04:27.509158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-537a5137-2df1-4cbe-adf0-c6f1f527cc7a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.100867 Oct 19 22:04:27.514120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 172/364] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:04:27 2022] POST /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd/os-volume_attachments => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 22:04:27.534326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-007b7de6-0824-48a2-bf2b-04c871dfae6e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:27.535169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:27.536082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:27.550578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.551032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.551480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.552184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.552807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.556314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.558132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-007b7de6-0824-48a2-bf2b-04c871dfae6e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1213 microversion: 2.1 time: 0.181251 Oct 19 22:04:27.560852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 193/365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:27 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:27.849695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-673270cc-c5a3-4480-8e88-b6d215a6d6d0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd/action" status: 202 len: 0 microversion: 2.1 time: 0.330327 Oct 19 22:04:27.853709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 173/366] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:04:27 2022] POST /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 22:04:27.860210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:27.861407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:27.879156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.880064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.885831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.887060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.887717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.888442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.968856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:27.970132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:27.980356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.991494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.997307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:27.998479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:27.999193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:27.999811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:28.315967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:28.331635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:28.333122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:28.334291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6f03ccc-e23b-40c4-bfad-6e611c2e10e8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1745 microversion: 2.20 time: 0.370052 Oct 19 22:04:28.334851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 174/367] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:28.508040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:28.523277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-87abb9c5-a23b-4b81-aeda-4fadec7259c7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1509 microversion: 2.1 time: 0.666198 Oct 19 22:04:28.523729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 194/368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:27 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1509 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:28.585427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-83335c2d-8298-43fc-9ac1-faa1bb2fec13 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:28.585928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-83335c2d-8298-43fc-9ac1-faa1bb2fec13 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:28.647841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83335c2d-8298-43fc-9ac1-faa1bb2fec13 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:28.656037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-83335c2d-8298-43fc-9ac1-faa1bb2fec13 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1213 microversion: 2.1 time: 0.076506 Oct 19 22:04:28.656940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 175/369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:28 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:28.911972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:28.912407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:28.926006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:28.934886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:28.942144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:28.943265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:28.945558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:28.947290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.001781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Going to try to terminate instance {{(pid=121022) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:04:29.363121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:29.364663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:29.373707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.374206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.374652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.375534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.377952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.381879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.488157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9efe16bb-495e-40c3-9243-5dea7a33bf33 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 204 len: 0 microversion: 2.1 time: 0.580205 Oct 19 22:04:29.489773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 195/370] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:04:28 2022] DELETE /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:04:29.502660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:29.504522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:29.535623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.536378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.536957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.537677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.538183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.538921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.659001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:29.662622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:29.672535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:29.692267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:29.697383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d19e9154-3e45-4a83-a4eb-a4a400645178 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1745 microversion: 2.20 time: 0.339489 Oct 19 22:04:29.723583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 176/371] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1745 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:29.736067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:29.738977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:29.756834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.760085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.760802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.763235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.764096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.768612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.823600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:29.833290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-705a7a84-ea07-4206-a60b-da6608a3da16 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1514 microversion: 2.1 time: 0.338554 Oct 19 22:04:29.838552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 196/372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:29 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1514 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:29.852466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:29.852805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:29.863342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.867388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.867388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.867388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:29.867388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:29.867960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:29.904862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:29.954918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:29.965830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-580a1d70-21f9-4a34-9de7-a66fb03e59b9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1265 microversion: 2.1 time: 0.129313 Oct 19 22:04:29.967000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 197/373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:29 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:29.988226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-975125454", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a761516-5fa0-488a-a25d-116b70e5b05e"}], "security_groups": [{"name": "tempest-securitygroup--49083398"}], "key_name": "tempest-keypair-15250024", "user_data": "}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:30.110237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] validate_networks() for [('4a761516-5fa0-488a-a25d-116b70e5b05e', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:04:30.172926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:30.182989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-051ade94-eb97-47c8-964b-19fad09e3f3a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1509 microversion: 2.1 time: 0.458105 Oct 19 22:04:30.185438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 177/374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:29 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1509 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:30.725871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:30.726501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:30.733477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:30.734261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:30.734935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:30.736021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:30.736719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:30.737352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:30.784613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:04:30.785316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:04:30.786152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:04:30.786782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:04:30.787411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:04:30.798846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:30.799359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:30.799792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:30.800812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:30.801273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:30.801719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:30.822290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:30.826348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:30.839183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:04:30.841723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:04:30.854361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:30.988189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:31.001695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a1342ea5-3736-4313-af3a-9dc4c0c40f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.025350 Oct 19 22:04:31.006099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:31.008405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:31.010532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dab11d03-525a-428f-b908-2f0289ee3547 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1745 microversion: 2.20 time: 0.288781 Oct 19 22:04:31.011345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 178/375] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1745 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:31.020332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:31.020332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:31.026423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 198/376] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:04:29 2022] POST /compute/v2.1/servers => generated 400 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:04:31.029056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:31.029783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:31.031077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:31.032012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:31.033575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:31.034786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:31.042286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:31.045394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:31.054271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:31.054771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:31.055287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:31.056245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:31.056888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:31.057702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:31.169060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:31.176799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78b0d90c-cf67-48bb-94af-3160bf9eee81 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1265 microversion: 2.1 time: 0.149562 Oct 19 22:04:31.193584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 199/377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:31 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:31.198444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d3179791-9475-4652-8476-4a65a2b8c01d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:31.199150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d3179791-9475-4652-8476-4a65a2b8c01d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:31.271901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d3179791-9475-4652-8476-4a65a2b8c01d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:31.282081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d3179791-9475-4652-8476-4a65a2b8c01d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1239 microversion: 2.1 time: 0.087270 Oct 19 22:04:31.283032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 200/378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:31 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:31.287874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:31.288796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:31.292598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:31.295964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:31.296728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:31.297215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:31.298356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:31.299032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:31.299605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:31.305726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5957571b-93e7-43cf-90af-01762bd47296 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1514 microversion: 2.1 time: 0.292266 Oct 19 22:04:31.321922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 179/379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:31 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1514 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:31.446516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:31.456502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-87067605-3933-4a46-bca3-180f9ecaeab6 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1509 microversion: 2.1 time: 0.171815 Oct 19 22:04:31.457306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 201/380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:31 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:32.043571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:32.044274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:32.051288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.051782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.052229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.052940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.053658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.054165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.200566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:32.201682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:32.208698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.209187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.209849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.210602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.211221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.218605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.294180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:32.295575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:32.302388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:32.304687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:32.306641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-90aefbe4-b755-4156-8fc2-8cce317644a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1745 microversion: 2.20 time: 0.267473 Oct 19 22:04:32.307526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 180/381] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1745 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:32.309401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-04a70205-d955-4413-b5c6-2b74e9258147 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1265 microversion: 2.1 time: 0.112463 Oct 19 22:04:32.310928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 202/382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:32 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:32.331278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-2dd7a2f2-3dd8-406a-9bba-72afc826f4a6 req-c0529e77-3e3e-4178-a26d-f88e2120c3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "name": "network-vif-plugged", "status": "completed", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:32.331689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:32.332481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:32.340541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.341395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.342264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.343169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.343767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.344335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.345036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-2dd7a2f2-3dd8-406a-9bba-72afc826f4a6 req-c0529e77-3e3e-4178-a26d-f88e2120c3ce service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.345525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-2dd7a2f2-3dd8-406a-9bba-72afc826f4a6 req-c0529e77-3e3e-4178-a26d-f88e2120c3ce service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.345962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-2dd7a2f2-3dd8-406a-9bba-72afc826f4a6 req-c0529e77-3e3e-4178-a26d-f88e2120c3ce service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.371462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-2dd7a2f2-3dd8-406a-9bba-72afc826f4a6 req-c0529e77-3e3e-4178-a26d-f88e2120c3ce service nova] Creating event network-vif-plugged:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:04:32.377812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-2dd7a2f2-3dd8-406a-9bba-72afc826f4a6 req-c0529e77-3e3e-4178-a26d-f88e2120c3ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053713 Oct 19 22:04:32.378605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 203/383] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:32.385113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:32.385789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:32.392706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.397038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.397038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.397038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.397038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.397383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.436788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:32.445121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e5171103-da78-4358-be23-d7c686e6c3c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1243 microversion: 2.1 time: 0.136330 Oct 19 22:04:32.446048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 181/384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:32 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1243 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:32.485401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:32.486017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:32.497755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.497755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.497755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.497755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:32.498162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:32.498162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:32.543716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:32.552472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8082803a-b591-4601-86f7-1edcdbccb403 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1514 microversion: 2.1 time: 0.172163 Oct 19 22:04:32.552915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 204/385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:32 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:32.715104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:32.730308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-624db6d0-0c1f-4561-99bf-6c616bcdad9d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1509 microversion: 2.1 time: 0.248577 Oct 19 22:04:32.731580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 182/386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:32 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:33.336531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:33.338721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:33.338859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:33.339440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:33.345677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.346577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.347194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.348071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.348523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.349579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.356493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.358451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.362194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.367185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.367185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.367185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.440821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:33.449211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2b3c2d38-868b-41ed-80f9-16257293676f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1265 microversion: 2.1 time: 0.119150 Oct 19 22:04:33.449791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 183/387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:33 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:33.472253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:33.472970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:33.495182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.495761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.496279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.504813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.505882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.506550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.592660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:33.602694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c06517bd-420a-4ce5-9621-50a67741dc8a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1235 microversion: 2.1 time: 0.132861 Oct 19 22:04:33.603825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 184/388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:33 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1235 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:33.609118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:33.609979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:33.616836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.618318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.619121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.620055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.620725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.621380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.773962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:33.789849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:33.793192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:33.801725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0bf99925-179b-492a-a2a9-00f161afb64b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1745 microversion: 2.20 time: 0.471567 Oct 19 22:04:33.807045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:33.814806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 205/389] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1745 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:33.819415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-59198401-c481-4ffa-b204-a807928af399 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1514 microversion: 2.1 time: 0.213997 Oct 19 22:04:33.820525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 185/390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:33 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:33.831908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:33.833216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:33.839921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.840804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.841471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:33.842379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:33.843073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:33.843867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.058430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:34.066493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4934536b-748f-45e9-a095-9b055b1a11ef tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1515 microversion: 2.1 time: 0.249498 Oct 19 22:04:34.097857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 206/391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:33 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:34.374432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-f840fe1f-0c19-4a1c-a33a-78b9fac3f780 req-19b9a2e2-dd54-4107-9cee-de28f9bccf7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcf0c7b-b225-403e-bba5-f37638c3c75e", "name": "network-vif-deleted", "tag": "e4aea8d2-d7a3-4d23-be2e-059743619d11"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:34.401655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-f840fe1f-0c19-4a1c-a33a-78b9fac3f780 req-19b9a2e2-dd54-4107-9cee-de28f9bccf7f service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.402516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-f840fe1f-0c19-4a1c-a33a-78b9fac3f780 req-19b9a2e2-dd54-4107-9cee-de28f9bccf7f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.403236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-f840fe1f-0c19-4a1c-a33a-78b9fac3f780 req-19b9a2e2-dd54-4107-9cee-de28f9bccf7f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.431424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-f840fe1f-0c19-4a1c-a33a-78b9fac3f780 req-19b9a2e2-dd54-4107-9cee-de28f9bccf7f service nova] Creating event network-vif-deleted:e4aea8d2-d7a3-4d23-be2e-059743619d11 for instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e on hv-cinder-maste Oct 19 22:04:34.477663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-f840fe1f-0c19-4a1c-a33a-78b9fac3f780 req-19b9a2e2-dd54-4107-9cee-de28f9bccf7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117751 Oct 19 22:04:34.477910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:34.478476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:34.480455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 186/392] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:34.503351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.504118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.504836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.505945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.507414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.509326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.588656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:34.598833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-20468fb7-0c0e-431c-90df-d24498db439b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1273 microversion: 2.1 time: 0.126747 Oct 19 22:04:34.599660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 207/393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:34 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:34.628991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:34.629594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:34.642296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.642816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.643294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.644030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.644479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.644910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.803558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:34.834804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9e913f04-7b7a-4b0b-bccd-b750bddb4c3c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1291 microversion: 2.1 time: 0.195636 Oct 19 22:04:34.840459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:34.843179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:34.847919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 187/394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:34 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1291 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:34.854154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.856827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.857046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:34.859613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.860597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.861044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:34.863128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.863916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.871086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.871875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.872494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:34.873377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:34.874043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:34.874623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:35.019449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:35.037170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-97ff8fa1-45a0-4e05-bfe1-e08523972971 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1304 microversion: 2.1 time: 0.188008 Oct 19 22:04:35.038933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 188/395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:34 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:35.629109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:35.629894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:35.629894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:35.640701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:35.640947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:35.641317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:35.641753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:35.643283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:35.644867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8c70b71-2093-4d28-88c0-4fff7ef50213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.808798 Oct 19 22:04:35.645668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 208/396] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:35.659327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:35.659327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:35.659327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:35.862335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:35.868151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:35.874323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:35.874896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:35.877298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:35.878078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:35.878550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:35.878998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:35.913590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:35.930443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-189f2bd7-9b3c-4c23-a92e-7287a9653fce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1271 microversion: 2.1 time: 0.307708 Oct 19 22:04:35.934560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 189/397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:35 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:36.062638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:36.066134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:36.075467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:36.076839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:36.078138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:36.083612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:36.084456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:36.089181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:36.188482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:36.189271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:36.189924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:36.190539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lazy-loading 'fault' on Instance uuid 3bcf0c7b-b225-403e-bba5-f37638c3c75e {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:04:36.271269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:36.281072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf09f7c6-ec87-4d09-8ce1-deeaeada2a39 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1291 microversion: 2.1 time: 0.423108 Oct 19 22:04:36.286649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 209/398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:35 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1291 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:36.381459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:36.396681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f0c6de2-7bcb-48f1-980b-89eb3e670750 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 200 len: 1309 microversion: 2.1 time: 0.338481 Oct 19 22:04:36.397276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 190/399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:36 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 1309 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:36.559369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6b29e2aa-7748-414a-9837-55e0397ece9c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'create', calling method: .version_select at 0x7f7333190430>, body: {"keypair": {"name": "tempest-keypair-509785875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvxQiOOlO7kc7FLUbBml0i0DJGtxNwmCT2CCgHYDscfkpbz9pYmDIiqhZLfjtKNQw0ZqxJB9liOzcKndZIYz2aX390FLu/esOo6E5ARSzwx3GsFVYH83jxw5t8gz9zzeQ=="}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:36.595223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-6b29e2aa-7748-414a-9837-55e0397ece9c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for project 65cb45d314f743799145a0fc614ce83e. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:36.614977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-6b29e2aa-7748-414a-9837-55e0397ece9c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for user 2c7d8acfab1041fc8edf36fd42b06993 and project 65cb45d314f743799145a0fc614ce83e. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:36.672447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:36.673931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:36.683643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=88 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:36.692331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:36.704978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6b29e2aa-7748-414a-9837-55e0397ece9c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149363 Oct 19 22:04:36.706702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 210/400] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:04:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:36.707420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:36.708566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:36.715378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:36.720109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:36.721749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:36.962052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:36.962662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:36.977180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:36.977719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:36.978157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:36.981082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:36.982222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:36.982869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:37.180476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:37.197433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:37.202544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:37.206539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-998aa686-baa7-49f7-a4ba-8c53afcefa86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.535625 Oct 19 22:04:37.219890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 191/401] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:37.316702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:37.322395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:37.335983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:37.338146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:37.338864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:37.344603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:37.346387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:37.354329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:37.555254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:37.563144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d0334f56-cd14-48cd-a1cc-d62933a227ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1297 microversion: 2.1 time: 0.252220 Oct 19 22:04:37.567498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 192/402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:37 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1297 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:37.585677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:37.596794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: 3bcf0c7b-b225-403e-bba5-f37638c3c75e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:37.626416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:37.626921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:37.641540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:37.642887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:37.645167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:37.645830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:37.701927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] HTTP exception thrown: Instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e could not be found. Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Request method failure captured: Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e HTTP/1.1 Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHQc_b8sEnY4l_Qbor9b9hDsOTYmSwnBTiTwfTVq77NqciZca0jQDY6n9Se_8hO3rlA3ZHpauJvF1RLfrZeMI43tfDTMOrGJPz8lVNTTcN7LexNAZDk50SkSwXgwZ2aL_kEZk9febpDKJNnbVQU952tMjYlZ4oRcfJywVC_XUg7eh6A Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 6ec4ff60137544109a46d3a5810251f5 Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1273423284 Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:04:37.712652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ec4ff60137544109a46d3a5810251f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ec4ff60137544109a46d3a5810251f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ec4ff60137544109a46d3a5810251f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ec4ff60137544109a46d3a5810251f5"}]}] Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-VolumesSnapshotTestJSON-1273423284 Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 6ec4ff60137544109a46d3a5810251f5 Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1273423284 Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-VolumesSnapshotTestJSON-1273423284-project Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 7ea5afc217f843389fe051b42616e09d Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-VolumesSnapshotTestJSON-1273423284-project Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e could not be found. Oct 19 22:04:37.714188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '3bcf0c7b-b225-403e-bba5-f37638c3c75e'} Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e could not be found. Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:04:37.714921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e could not be found. Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e could not be found. Oct 19 22:04:37.716966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:04:37.719652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Returning 404 to user: Instance 3bcf0c7b-b225-403e-bba5-f37638c3c75e could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:04:37.719652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6d843815-ff9c-4a39-a2a0-8fc83ea4576d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e" status: 404 len: 111 microversion: 2.1 time: 0.145729 Oct 19 22:04:37.719652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 193/403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:37 2022] GET /compute/v2.1/servers/3bcf0c7b-b225-403e-bba5-f37638c3c75e => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:04:38.123747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:38.155151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a43d478c-38c5-479f-bfca-c090bc09e9cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 1.189153 Oct 19 22:04:38.157353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 211/404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:36 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:38.237134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:38.237699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:38.246742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:38.249391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:38.249391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:38.249391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:38.256082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:38.256621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:38.286917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:38.592378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:38.593403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:38.609134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:38.610422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:38.610877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:38.615646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:38.622752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:38.625134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:38.655198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:38.724879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:38.736627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:38.742725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:38.744366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d693dee8-3374-4c1e-a887-9aa7b4179086 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.511210 Oct 19 22:04:38.745944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 194/405] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:39.180185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:39.180820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:39.199341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:39.200174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:39.200851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:39.206068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:39.210289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:39.215159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:39.217321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:39.223206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1efa96b2-41f7-4e96-b901-36028893ea58 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1297 microversion: 2.1 time: 0.631608 Oct 19 22:04:39.227105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 212/406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:38 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1297 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:39.527721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:39.536217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ff7109df-2daf-4198-a599-55d79259b26b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.361202 Oct 19 22:04:39.536802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 195/407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:39 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:39.822082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:39.824569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:39.869495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:39.871622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:39.884731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:39.893956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:39.895861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:39.896598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:40.079732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-83730c31-df14-4a6a-a4ea-1e781e197ce6 req-4e580d28-4fa3-4816-8d35-5e66536e8f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c839cebb-9e6d-4a76-9f23-858d73e7ff65", "tag": "532331de-7c0b-4f50-b5c7-4fbc9aebc34b"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:40.096274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-83730c31-df14-4a6a-a4ea-1e781e197ce6 req-4e580d28-4fa3-4816-8d35-5e66536e8f0d service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:40.100167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-83730c31-df14-4a6a-a4ea-1e781e197ce6 req-4e580d28-4fa3-4816-8d35-5e66536e8f0d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:40.100889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-83730c31-df14-4a6a-a4ea-1e781e197ce6 req-4e580d28-4fa3-4816-8d35-5e66536e8f0d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:40.118694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-83730c31-df14-4a6a-a4ea-1e781e197ce6 req-4e580d28-4fa3-4816-8d35-5e66536e8f0d service nova] Creating event network-changed:532331de-7c0b-4f50-b5c7-4fbc9aebc34b for instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 on hv-cinder-maste Oct 19 22:04:40.147744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-83730c31-df14-4a6a-a4ea-1e781e197ce6 req-4e580d28-4fa3-4816-8d35-5e66536e8f0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104705 Oct 19 22:04:40.154901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 196/408] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:04:40.177637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:40.192984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:40.194655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:40.195928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09a7886d-64be-48cb-a168-93d73d41a8e6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.415759 Oct 19 22:04:40.196889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 213/409] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:40.248169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:40.249343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:40.259001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:40.259717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:40.260370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:40.261285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:40.261941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:40.262566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:40.564388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:40.566139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:40.574259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:40.575166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:40.576090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:40.577037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:40.578080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:40.578802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:40.749157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:40.759325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9f23a192-d81c-4892-add7-d8ebe6613b65 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.199084 Oct 19 22:04:40.763099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 214/410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:40 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:40.776723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:40.785180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-416688f5-90fb-453f-8e30-76bc442c148e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.541149 Oct 19 22:04:40.785762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 197/411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:40 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:41.224193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:41.224804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:41.227282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:41.237183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:41.237985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:41.238100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:41.239401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:41.239401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:41.240041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:41.562033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:41.585740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:41.587268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:41.588437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c86b72db-e93c-4a36-9d67-38e518c1519a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.368202 Oct 19 22:04:41.592172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 215/412] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:41.797227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:41.797539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:41.801894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-333171272", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2879824-dc50-40d2-9504-357f60cd02db"}], "security_groups": [{"name": "tempest-securitygroup--2109607903"}], "key_name": "tempest-keypair-509785875", "user_data": "}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:41.818098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:41.827814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:41.828155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:41.828904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:41.829368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:41.829800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:42.781825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:42.792901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2c29f445-60b8-4a4d-853f-955de0aea186 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 1.013185 Oct 19 22:04:42.813284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 216/413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:41 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:42.825073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:42.826192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:42.841062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:42.841803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:42.842431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:42.843848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:42.845695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:42.846298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:42.893827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:43.361399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:43.370664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aee1818a-0dd8-4322-9f4e-f1a384e2075a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.555655 Oct 19 22:04:43.373661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 217/414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:42 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:43.384182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:43.393294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:43.404205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:43.404890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:43.407457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:43.408248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:43.408718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:43.411586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:43.655909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:43.674755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:43.676420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:43.677384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3a49114e-db85-417e-af58-25f303343ae2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.301710 Oct 19 22:04:43.703599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 218/415] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:43.817157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:43.818488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:43.827598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:43.834171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:43.834989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:43.838808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:43.839564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:43.840213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:44.539002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:44.549671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3e6401b3-0cec-4902-94d1-96f1b7cc27bf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.736116 Oct 19 22:04:44.550491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 219/416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:43 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:44.557244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:44.574513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:44.588074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:44.600504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:44.608874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:44.608874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:44.608874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:44.608874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:45.411530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:45.420255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-86b0ff73-6ee1-495c-aaab-662bc04b1a74 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.867958 Oct 19 22:04:45.420833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 220/417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:44 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:45.425772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:45.426531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:45.433297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:45.434027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:45.435935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:45.436949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:45.437644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:45.438347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:45.768499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:45.776836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:45.778275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:45.779482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ae01fb0a-d1c2-4add-8344-40a21bfa6ee0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.357464 Oct 19 22:04:45.780036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 221/418] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:45.798380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-a6859bba-72ba-4d49-9108-3029170576f4 req-ad2abeaa-b8a0-4c0e-a7e5-c3970ac50f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e0e488-cb92-478d-8aa4-357c3773dedc", "tag": "0cb10885-0f37-4381-a5f7-eebc5f05f951"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:45.812881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-a6859bba-72ba-4d49-9108-3029170576f4 req-ad2abeaa-b8a0-4c0e-a7e5-c3970ac50f1b service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:45.812881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-a6859bba-72ba-4d49-9108-3029170576f4 req-ad2abeaa-b8a0-4c0e-a7e5-c3970ac50f1b service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:45.812881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-a6859bba-72ba-4d49-9108-3029170576f4 req-ad2abeaa-b8a0-4c0e-a7e5-c3970ac50f1b service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:45.821185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-a6859bba-72ba-4d49-9108-3029170576f4 req-ad2abeaa-b8a0-4c0e-a7e5-c3970ac50f1b service nova] Creating event network-changed:0cb10885-0f37-4381-a5f7-eebc5f05f951 for instance 47e0e488-cb92-478d-8aa4-357c3773dedc on hv-cinder-maste Oct 19 22:04:45.825983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-a6859bba-72ba-4d49-9108-3029170576f4 req-ad2abeaa-b8a0-4c0e-a7e5-c3970ac50f1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044786 Oct 19 22:04:45.826580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 222/419] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:45.831770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:45.832472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:45.838986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:45.839874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:45.839995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:45.840612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:45.841067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:45.841488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:46.024292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:46.032568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e38ece9d-7480-48f8-9316-d8baf326a261 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.204681 Oct 19 22:04:46.033254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 223/420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:45 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:46.446932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:46.447598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:46.469282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:46.470118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:46.470736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:46.471662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:46.472414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:46.478528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:46.623484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=24 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:46.729701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:46.744075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bdc538cf-5b65-437a-a782-9c1b25852c3a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.302116 Oct 19 22:04:46.761119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 224/421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:46 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:46.809542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:46.810313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:46.825132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:46.825637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:46.826085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:46.826793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:46.827278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:46.832339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:47.025380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:47.042591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:47.044738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:47.048041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-078f3763-265e-4bfe-bdf8-5c73e2e95019 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.243372 Oct 19 22:04:47.049780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 225/422] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:47.062224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:47.066009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:47.085401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:47.086227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:47.095765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:47.097093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:47.097986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:47.098577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:47.363877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:47.381566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ad6c2f03-088a-4a8a-8601-a75f522ff8a6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.325796 Oct 19 22:04:47.382490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 226/423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:47 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:47.771751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:47.774276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:47.803522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:47.805054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:47.807920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:47.813169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:47.813917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:47.814562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:48.084927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:48.093221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e98da58b-3b0f-4f3b-85a3-df8e8cd25446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.325379 Oct 19 22:04:48.097695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 227/424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:47 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:48.119444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:48.120333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:48.132274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:48.133098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:48.136221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:48.137122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:48.137731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:48.138586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:48.347174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:48.379159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:48.379159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:48.379159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dd49520f-d17e-41ba-8489-ddfa708c682c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.263852 Oct 19 22:04:48.379549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 228/425] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:48.418297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:48.418899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:48.438497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:48.450345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:48.450345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:48.450345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:48.450345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:48.450835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:48.753736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:48.771786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-870863a2-c8a9-4686-8692-ab418313a1b8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.359228 Oct 19 22:04:48.772757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 229/426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:48 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:49.122985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:49.123996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:49.219220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:49.219220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:49.219220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:49.219220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:49.219577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:49.219577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:49.432692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:49.440723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aebc59da-880a-441e-a65c-7f6fa6500857 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.322550 Oct 19 22:04:49.441289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 230/427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:49 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:49.447627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-772149912", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "networks": [{"uuid": "275a8c53-9b34-4fa1-b26b-d3a2b74fcd81"}]}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:50.781785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=16 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:51.885347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=15 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:51.942710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] validate_networks() for [('275a8c53-9b34-4fa1-b26b-d3a2b74fcd81', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:04:51.987686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] validate_networks() for [('d2879824-dc50-40d2-9504-357f60cd02db', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:04:52.384306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:04:52.384732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:04:52.385198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:04:52.385597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:04:52.386006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:04:52.394833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.395342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.395779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.396505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.396952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.397370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.414712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for project 65cb45d314f743799145a0fc614ce83e. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:52.419009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Getting quotas for user 2c7d8acfab1041fc8edf36fd42b06993 and project 65cb45d314f743799145a0fc614ce83e. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:52.430685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:04:52.433019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:04:52.500733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:04:52.501149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:04:52.501619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:04:52.502022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:04:52.502427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:04:52.511310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.511786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.512216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.512932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.513382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.513809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.529973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Getting quotas for project 6ec4ff60137544109a46d3a5810251f5. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:52.533870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Getting quotas for user 7ea5afc217f843389fe051b42616e09d and project 6ec4ff60137544109a46d3a5810251f5. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:52.545106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:04:52.547477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:04:52.563165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ec09ad04-4377-4fa8-86f2-ad77d37faba2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 10.787878 Oct 19 22:04:52.563815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 198/428] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:04:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 10789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:04:52.568486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:52.569087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:52.577129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.577663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.578089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.578784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.579327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.579745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.694412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-de5a3b23-67c2-4a45-935c-5eb3c607179a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.250185 Oct 19 22:04:52.696376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 231/429] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:04:52.701180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:52.702132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:52.711010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.711667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.712190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.712985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.713570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.714119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.722012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:52.742086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:52.743630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:52.746131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3c15494e-bf46-4ac6-91b9-31d6e1819cb2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1740 microversion: 2.20 time: 0.181389 Oct 19 22:04:52.746695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 199/430] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:52.752096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:52.752649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:52.759069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.759635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.760563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.761275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:52.761732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:52.762158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:52.875193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:52.883913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-68d1bce4-cefd-4cda-927f-57cb649a18a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.186239 Oct 19 22:04:52.885027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 232/431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:52 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:52.889908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ef96986-8fbc-4444-b234-68e4d059bed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Action: 'create', calling method: .version_select at 0x7f7333157160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1898465471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/rqWv2IWLcGSzAlXtACM/5sVD2uNQCNeRJm3xG7oY2AjquOlT2sfkopG8HKk4ruxxRFfAqT1SLu21Q9cTaub1Fws9f5DrotXPBabp1QVuqavHQgWd3HaMcHPizmY6bdA=="}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:52.905195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:52.912261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-1ef96986-8fbc-4444-b234-68e4d059bed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Getting quotas for project 6529fcc0c4c4487ab023942957692c3a. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:52.916860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-1ef96986-8fbc-4444-b234-68e4d059bed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Getting quotas for user 86dbc6cb1f144de9b83ccac964a1b3da and project 6529fcc0c4c4487ab023942957692c3a. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:52.930591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:52.939137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-64ae7f05-3eda-4e55-847b-7cc704abee63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.190903 Oct 19 22:04:52.939708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 200/432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:52 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:52.944293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-02578ea4-0edf-40bc-bb5d-2595bc3d2c87 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:52.944905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-02578ea4-0edf-40bc-bb5d-2595bc3d2c87 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:52.998056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-02578ea4-0edf-40bc-bb5d-2595bc3d2c87 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:53.004982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-02578ea4-0edf-40bc-bb5d-2595bc3d2c87 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1244 microversion: 2.1 time: 0.064059 Oct 19 22:04:53.005481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 201/433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:52 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1244 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:53.010643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-69fc041e-cc31-47dd-9835-984f08b605d9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:53.011253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-69fc041e-cc31-47dd-9835-984f08b605d9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:53.022344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ef96986-8fbc-4444-b234-68e4d059bed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.136015 Oct 19 22:04:53.023672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 233/434] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:04:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:53.073572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-69fc041e-cc31-47dd-9835-984f08b605d9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:53.078750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1996258313", "imageRef": "07fc5eb0-cb61-49d1-8c15-e95bc36c5c87", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1898465471", "networks": [{"uuid": "b5bc64b0-94d5-485c-99db-c887ab6ff4e8"}]}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:53.091169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-69fc041e-cc31-47dd-9835-984f08b605d9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1218 microversion: 2.1 time: 0.075339 Oct 19 22:04:53.091169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 202/435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:53 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:53.128876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] validate_networks() for [('b5bc64b0-94d5-485c-99db-c887ab6ff4e8', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:04:53.516799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:04:53.517227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:04:53.517708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:04:53.518117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:04:53.518526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:04:53.527097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.527582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.528020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:53.528752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.529236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.529667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:53.546141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Getting quotas for project 6529fcc0c4c4487ab023942957692c3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:04:53.550102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Getting quotas for user 86dbc6cb1f144de9b83ccac964a1b3da and project 6529fcc0c4c4487ab023942957692c3a. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:04:53.567629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:04:53.570635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='07fc5eb0-cb61-49d1-8c15-e95bc36c5c87',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:04:53.698846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-42c4d279-bfa1-496b-bcf4-cc2f245db939 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624209 Oct 19 22:04:53.699525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 234/436] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 22:04:53.710621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d2279123-4718-415f-b7cd-e360b693f59f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:53.711366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d2279123-4718-415f-b7cd-e360b693f59f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:53.764212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d2279123-4718-415f-b7cd-e360b693f59f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:53.771343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d2279123-4718-415f-b7cd-e360b693f59f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1259 microversion: 2.1 time: 0.064723 Oct 19 22:04:53.772197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 203/437] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:53.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:53.776514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:53.784559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.785105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.785576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:53.786387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.786833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.787287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:53.908858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:53.909459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:53.917066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.917608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.918048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:53.918379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:53.918733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.919207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.919627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:53.927103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:53.928822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:53.930668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-90616a96-9df9-4c69-b787-f639be3cf44c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1722 microversion: 2.20 time: 0.159344 Oct 19 22:04:53.931262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 235/438] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:04:53.961482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:53.962098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:53.968116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.968603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.969059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:53.969737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:53.970190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:53.970615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:54.049685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:54.058636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cfe050b7-ce6c-44bd-baf5-c7a2ba698e85 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.153546 Oct 19 22:04:54.059233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 204/439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:53 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:54.070733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:54.071584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:54.077554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:54.078043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:54.078483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:54.079216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:54.079676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:54.080103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:54.105951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:54.115541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8d62bada-060a-4b63-ae9b-ee74ee6701ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.157663 Oct 19 22:04:54.116140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 236/440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:53 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:54.121346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:54.121988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:54.128057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:54.128544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:54.129009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:54.129696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:54.130144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:54.130562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:54.134618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:54.153218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:54.160805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-edbe5c97-d0de-47a1-9ee2-69e5e7e6e92f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1248 microversion: 2.1 time: 0.094412 Oct 19 22:04:54.161374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 205/441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:54 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:54.195073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:54.203118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-481932ed-c8ba-4523-83ff-939a99ce8f7b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1222 microversion: 2.1 time: 0.085853 Oct 19 22:04:54.203678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 237/442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:54 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:54.800874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5c44e165-aa5c-4bde-90ad-0b5aa8719900 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:54.805094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5c44e165-aa5c-4bde-90ad-0b5aa8719900 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:54.860038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c44e165-aa5c-4bde-90ad-0b5aa8719900 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:54.867141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5c44e165-aa5c-4bde-90ad-0b5aa8719900 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1259 microversion: 2.1 time: 0.070870 Oct 19 22:04:54.868842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 206/443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:54.958132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:54.959086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:54.965375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:54.965879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:54.966317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:54.967284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:54.967509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:54.967936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.081683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:55.082383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:55.089917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.090403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.090837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.091583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.092042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.092460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.183301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.192752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.194188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.196107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b907f5df-7541-4d91-bb56-a7520c90f2c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1722 microversion: 2.20 time: 0.243444 Oct 19 22:04:55.209243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 238/444] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:55.209243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:55.209243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:55.209243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.214338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.214338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.214338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.214338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.214664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.236716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.245008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e8e67256-291a-40d6-a9d8-e2ae69b1580e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.167479 Oct 19 22:04:55.245578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 207/445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:55 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:55.250157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:55.250751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:55.256540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.257020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.258080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.258766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.259237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.259655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.320399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.328213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-33948fe0-a87b-4067-9ef3-fbdb6f56c872 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1240 microversion: 2.1 time: 0.081684 Oct 19 22:04:55.328925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 208/446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:55 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:55.333352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:55.333956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:55.339612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.340102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.340529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.341219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.341670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.342092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.347135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.355248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-146b8f12-1648-42f6-8f3a-ed70b2542103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.157149 Oct 19 22:04:55.355807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 239/447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:55 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:55.405668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.413111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-90c73753-dc09-4a64-baa7-24bfb270861d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1270 microversion: 2.1 time: 0.083304 Oct 19 22:04:55.414260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 209/448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:55 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:55.889669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-3ae6d99a-df5f-4065-a357-35efe045b534 req-ce27f519-162d-47a6-aeac-586f46530fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "name": "network-vif-unplugged", "status": "completed", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:55.890033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:55.890656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:55.897415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.897907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.898784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.899613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.900071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.900494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.901621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3ae6d99a-df5f-4065-a357-35efe045b534 req-ce27f519-162d-47a6-aeac-586f46530fc1 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:55.902107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3ae6d99a-df5f-4065-a357-35efe045b534 req-ce27f519-162d-47a6-aeac-586f46530fc1 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:55.902531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3ae6d99a-df5f-4065-a357-35efe045b534 req-ce27f519-162d-47a6-aeac-586f46530fc1 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:55.913674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-3ae6d99a-df5f-4065-a357-35efe045b534 req-ce27f519-162d-47a6-aeac-586f46530fc1 service nova] Creating event network-vif-unplugged:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:04:55.919018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-3ae6d99a-df5f-4065-a357-35efe045b534 req-ce27f519-162d-47a6-aeac-586f46530fc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032969 Oct 19 22:04:55.919925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 240/449] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:04:55.963905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:55.971694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-231120d9-7823-4a56-ac30-ee34b302d4e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1255 microversion: 2.1 time: 0.085410 Oct 19 22:04:55.972343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 210/450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1255 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:56.222120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:56.222814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:56.229969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.230455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.230891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.231621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.232074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.232500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.275622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:56.276914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:56.283953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.284555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.285044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.285747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.286193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.286611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.371326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:56.379969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:56.381624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:56.382979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4c13a631-3165-471f-bf59-62dbb51f345c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1722 microversion: 2.20 time: 0.165071 Oct 19 22:04:56.384064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 241/451] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:56.388813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:56.391083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:56.403619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.404139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.404584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.405292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.406217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.406724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.433693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:56.441531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-66942c25-7c8b-415c-8cc3-f56615916dc5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.177313 Oct 19 22:04:56.442420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 211/452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:56 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:56.448416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:56.449088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:56.455201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.455691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.456127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.456850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.457303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.457778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.468387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:56.476703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e6f51261-7aeb-47a2-8528-31f8c1d54109 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1240 microversion: 2.1 time: 0.090882 Oct 19 22:04:56.477277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 242/453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:56 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:56.481668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:56.482281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:56.488213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.488696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.489210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.489821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:56.490280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:56.490757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:56.551499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:56.559343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-96f660e6-10b9-4cbf-b498-72f7a656d870 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1270 microversion: 2.1 time: 0.081065 Oct 19 22:04:56.560112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 243/454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:56 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:56.594409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:56.602717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-65193b3b-3f50-4440-b690-fcf7316284e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.159167 Oct 19 22:04:56.603320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 212/455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:56 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:56.996506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:56.997291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:57.004490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.005205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.005637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.006633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.007268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.007693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.086169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.094376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-de164e5e-4b29-4e19-bc4a-5ae80775983a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1255 microversion: 2.1 time: 0.103219 Oct 19 22:04:57.094987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 244/456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1255 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:57.409902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:57.410646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:57.417675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.418177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.418732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.419459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.419915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.420342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.465653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:57.466301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:57.472924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.473431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.473853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.474551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.475132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.475565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.554405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.564791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.566238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.567429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5c226a76-3398-4e3f-b940-125c42f15b14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1725 microversion: 2.20 time: 0.161659 Oct 19 22:04:57.568175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 213/457] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:04:57.573170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:57.573774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:57.584400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.584894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.585954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.586654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.587573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.588000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.660787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.668622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-092db80a-734d-4dfd-8ed6-30fe70431942 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1296 microversion: 2.1 time: 0.099616 Oct 19 22:04:57.669345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 214/458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:57 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:57.673987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:57.674584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:57.680589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.681067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.681499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.682179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.682819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.683452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.717860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.731722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-42dcd77d-35ad-48eb-b12a-05432e819741 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.269923 Oct 19 22:04:57.750436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 245/459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:57 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:57.756421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ba49c2d-3484-462e-a30a-e5bbc45ada19"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:57.761289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:57.770013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.771380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.773389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.774135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.774758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.775218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.778913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.788230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-90509e40-0a6c-49fb-81a9-9bf3e475c854 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1278 microversion: 2.1 time: 0.117543 Oct 19 22:04:57.789220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 215/460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:57 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:57.794880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:57.795996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:57.802542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.803725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.809022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.809022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:57.809022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:57.809022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:57.969099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:57.979380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-71dadf35-2d29-44d8-b195-e406863e07ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.188827 Oct 19 22:04:57.983027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 216/461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:57 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:58.118206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:58.118820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:58.124687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.125176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.125618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.126318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.126777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.127229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.216860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:58.224674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-25d46a5b-3b1b-4633-a3c4-a46e4e3dd1d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1255 microversion: 2.1 time: 0.110948 Oct 19 22:04:58.225246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 217/462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1255 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:58.375522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-313c58b2-c4c8-42ad-bd54-030cc0f106f8 req-d15cc152-33a9-4da7-87f0-42778f56ffe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e0e488-cb92-478d-8aa4-357c3773dedc", "name": "network-vif-plugged", "status": "completed", "tag": "0cb10885-0f37-4381-a5f7-eebc5f05f951"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:58.386503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-313c58b2-c4c8-42ad-bd54-030cc0f106f8 req-d15cc152-33a9-4da7-87f0-42778f56ffe0 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.387017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-313c58b2-c4c8-42ad-bd54-030cc0f106f8 req-d15cc152-33a9-4da7-87f0-42778f56ffe0 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.387447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-313c58b2-c4c8-42ad-bd54-030cc0f106f8 req-d15cc152-33a9-4da7-87f0-42778f56ffe0 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.399202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-313c58b2-c4c8-42ad-bd54-030cc0f106f8 req-d15cc152-33a9-4da7-87f0-42778f56ffe0 service nova] Creating event network-vif-plugged:0cb10885-0f37-4381-a5f7-eebc5f05f951 for instance 47e0e488-cb92-478d-8aa4-357c3773dedc on hv-cinder-maste Oct 19 22:04:58.404524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-313c58b2-c4c8-42ad-bd54-030cc0f106f8 req-d15cc152-33a9-4da7-87f0-42778f56ffe0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033149 Oct 19 22:04:58.408658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 218/463] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:04:58.692107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:58.692815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:58.705837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.706344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.706786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.709500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.709500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.709500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.793393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:58.800266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:04:58.806266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-59fd1415-a9d0-44d9-bd71-e61c048cc6cf tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1304 microversion: 2.1 time: 0.118242 Oct 19 22:04:58.807100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 219/464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:58 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:04:58.811607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:58.812538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:58.823387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.823908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.824602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.825362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.825900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.826233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.887693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-22b2e212-5d46-4bf9-9753-4980c2748cc9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.135825 Oct 19 22:04:58.893277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 246/465] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Oct 19 22:04:57 2022] POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 188 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:04:58.896053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:58.900633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:58.929027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.932847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.935190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:58.936294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:58.939669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:58.941316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.054443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:59.067570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4065a24c-d143-4985-8e3f-12995b69ba86 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.259569 Oct 19 22:04:59.068155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 220/466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:58 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:59.083089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:59.083089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:59.086327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.086327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.086327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.086611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.087098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.087522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.229037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:59.236660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-59c642c8-5a16-400d-8399-bf713b95de99 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.164958 Oct 19 22:04:59.237455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 221/467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:59 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:59.242046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:04:59.242430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:59.248240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.249145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.249756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.250602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.251090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.251519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.296083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121021) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 22:04:59.322533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:59.330326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-df2f1ae1-a1fc-4bf9-b76d-6b97405947fa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.438264 Oct 19 22:04:59.330890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 247/468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:58 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:59.338544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:59.339168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:59.344854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.345334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.345762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.346440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.346923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.347434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.421359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:59.431570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5b96ef2b-ea13-489f-a1f1-d6e9e596a3f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1311 microversion: 2.1 time: 0.099645 Oct 19 22:04:59.432146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 248/469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:04:59.709957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1050cedf-84ed-483e-a7ec-9371ab274893 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/action" status: 202 len: 0 microversion: 2.20 time: 0.471443 Oct 19 22:04:59.710899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 222/470] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 19 22:04:59 2022] POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:04:59.719270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:59.720017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:59.726735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.727360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.727893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.728787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.729333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.730014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.829967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:04:59.830576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:04:59.836964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.837676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.838280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.839177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:04:59.839786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:04:59.840452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:04:59.904162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:04:59.912887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fb89f990-7bf6-4db5-9740-ed32e7f8c6f0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1302 microversion: 2.1 time: 0.087259 Oct 19 22:04:59.914018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 223/471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:04:59 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:00.033038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:00.042377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:00.044611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:00.046343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-15d77776-1cdd-437f-948a-eb1efe51b1fe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1811 microversion: 2.20 time: 0.330931 Oct 19 22:05:00.047316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 249/472] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:04:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1811 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:00.089713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:00.091136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:00.097235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.097726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.098168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.098872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.099427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.099855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.135565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-0e4f3385-7a96-4a2e-98f6-61c35604e96b req-0d594a70-ef2f-48bf-b108-1b342b52d9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3772e1d-c468-46b9-95cf-d21bb0e427b6", "tag": "7db273b8-393f-4339-88f8-17078884c016"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:00.145887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0e4f3385-7a96-4a2e-98f6-61c35604e96b req-0d594a70-ef2f-48bf-b108-1b342b52d9c3 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.146482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0e4f3385-7a96-4a2e-98f6-61c35604e96b req-0d594a70-ef2f-48bf-b108-1b342b52d9c3 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.146997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0e4f3385-7a96-4a2e-98f6-61c35604e96b req-0d594a70-ef2f-48bf-b108-1b342b52d9c3 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.160221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-0e4f3385-7a96-4a2e-98f6-61c35604e96b req-0d594a70-ef2f-48bf-b108-1b342b52d9c3 service nova] Creating event network-changed:7db273b8-393f-4339-88f8-17078884c016 for instance c3772e1d-c468-46b9-95cf-d21bb0e427b6 on hv-cinder-maste Oct 19 22:05:00.166356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-0e4f3385-7a96-4a2e-98f6-61c35604e96b req-0d594a70-ef2f-48bf-b108-1b342b52d9c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034634 Oct 19 22:05:00.167048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 250/473] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:00.263923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:00.265097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:00.274477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.275434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.276038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.277163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.277788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.278366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.298345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:00.322001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-24960b74-933c-4917-8b18-ec5f273eaf61 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.235644 Oct 19 22:05:00.336349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 224/474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:00 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:00.355166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:00.361541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:00.364361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.364877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.365559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.366589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.367291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.367970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.591931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:00.600963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-333b78b2-7348-4ff6-8e7a-3854c01c2157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.251049 Oct 19 22:05:00.603695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 225/475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:00 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:00.609011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-73a78b0e-a51f-4a8f-972d-1c673b0a7ebc req-b6e80d26-adf1-4cbd-92a9-2728e690ebd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c839cebb-9e6d-4a76-9f23-858d73e7ff65", "name": "network-vif-plugged", "status": "completed", "tag": "532331de-7c0b-4f50-b5c7-4fbc9aebc34b"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:00.619622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-73a78b0e-a51f-4a8f-972d-1c673b0a7ebc req-b6e80d26-adf1-4cbd-92a9-2728e690ebd1 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.620105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-73a78b0e-a51f-4a8f-972d-1c673b0a7ebc req-b6e80d26-adf1-4cbd-92a9-2728e690ebd1 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.620534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-73a78b0e-a51f-4a8f-972d-1c673b0a7ebc req-b6e80d26-adf1-4cbd-92a9-2728e690ebd1 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.632546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-73a78b0e-a51f-4a8f-972d-1c673b0a7ebc req-b6e80d26-adf1-4cbd-92a9-2728e690ebd1 service nova] Creating event network-vif-plugged:532331de-7c0b-4f50-b5c7-4fbc9aebc34b for instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 on hv-cinder-maste Oct 19 22:05:00.639477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-73a78b0e-a51f-4a8f-972d-1c673b0a7ebc req-b6e80d26-adf1-4cbd-92a9-2728e690ebd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Oct 19 22:05:00.640227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 226/476] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:00.647331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:00.649347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:00.659603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.660631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.662799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.664447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.665300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.666136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.718177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:00.727118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fd99d58c-f40c-4557-af6b-03021a0ebe38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1363 microversion: 2.1 time: 0.470550 Oct 19 22:05:00.728003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 251/477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:00 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:00.748985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:00.756833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e6eba51c-e9a3-42ab-9015-a1001b3c0da2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1319 microversion: 2.1 time: 0.114592 Oct 19 22:05:00.757912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 227/478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1319 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:00.936852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:00.936852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:00.943579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.944075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.945360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.946437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:00.946866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:00.947326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:00.967806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:01.072946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:01.073588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:01.079781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.080276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.080842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.081403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.081857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.082279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.108588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:01.117249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8cef49ed-aa63-4530-bad0-a32e658cc618 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.184224 Oct 19 22:05:01.128995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 252/479] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:00 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:01.262671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:01.273950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:01.275880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:01.277310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01089077-eb4d-4bf5-ba2b-cb13016d74a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1811 microversion: 2.20 time: 0.208883 Oct 19 22:05:01.278161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 228/480] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1811 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:01.348216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:01.349700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:01.359815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.360517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.361102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.361962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.362708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.363365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.623635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:01.624271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:01.630140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.630617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.631918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.632618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.633073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.633495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.690640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:01.698528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cab7452b-86d9-4e74-bc7f-6da349522f8e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.356523 Oct 19 22:05:01.699280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 253/481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:01 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:01.768545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:01.773308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:01.798700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.802762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.803891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.805398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.805865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.806289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.825463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:01.833668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa34c64e-8e89-47fe-a9d7-8befe6c134c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.214111 Oct 19 22:05:01.834274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 229/482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:01 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:01.839964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:01.840934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:01.846903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.847601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.848101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.849482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:01.849985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:01.850601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:01.948954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:01.959183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fe5301f8-d2cf-4f08-9121-a1a8727b0fcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1317 microversion: 2.1 time: 0.123394 Oct 19 22:05:01.964205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 230/483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1317 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:02.139602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:02.140554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:02.146693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.148325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.148325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.148611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.149070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.149606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.174101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:02.184143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a5648d0d-dca6-44eb-90e7-37f889a0f976 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1553 microversion: 2.1 time: 0.435911 Oct 19 22:05:02.186796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 254/484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:01 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1553 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:02.215450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:02.215953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:02.232933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.233545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.234429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.235971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.236579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.237150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.377066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:02.387564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6f7bb4bd-c318-4d7c-bdd0-2be2154874e7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.251540 Oct 19 22:05:02.404796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 231/485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:02 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:02.415060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:02.416131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:02.419731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:02.423912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.424777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.425500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.426831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.427563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.428502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.430130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3b79815a-f77c-4f18-b019-a73e757e1c4e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220096 Oct 19 22:05:02.430727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 255/486] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 19 22:05:02 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:05:02.723009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:02.723876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:02.733063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.743789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.744983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.746091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.746725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.747393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.904732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:02.912588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:02.914567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:02.916400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-06ae0328-915c-4308-8842-54992454ee9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.509477 Oct 19 22:05:02.917178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 232/487] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:02.928720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:02.931502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:02.944626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.945395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.946004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:02.946871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:02.947371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:02.947796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.057463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:03.066447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-75273d45-fe8c-4197-9806-858d5cc53925 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.347427 Oct 19 22:05:03.067050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 256/488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:02 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:03.080892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:03.081690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:03.088354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.088929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.089440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.090286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.090818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.091336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.222372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:03.232796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4613a4d4-610b-470d-bbb3-48ff045b6972 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.313828 Oct 19 22:05:03.237069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 233/489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:02 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:03.245111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-de7d506c-b699-431e-be54-51585cea7676 req-4d3a9187-b052-459a-8cae-34c806aee249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d879744-3a18-481b-a9ec-441278759057", "tag": "d55a98d6-9b51-4575-9649-77cbfb1f5f1c"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:03.255876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:03.269023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-de7d506c-b699-431e-be54-51585cea7676 req-4d3a9187-b052-459a-8cae-34c806aee249 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.271713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-de7d506c-b699-431e-be54-51585cea7676 req-4d3a9187-b052-459a-8cae-34c806aee249 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.271832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:03.272273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-de7d506c-b699-431e-be54-51585cea7676 req-4d3a9187-b052-459a-8cae-34c806aee249 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.281970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-56041c50-d7ce-4967-ba7c-1d45283248f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.213816 Oct 19 22:05:03.283395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 257/490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:03.286126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-de7d506c-b699-431e-be54-51585cea7676 req-4d3a9187-b052-459a-8cae-34c806aee249 service nova] Creating event network-changed:d55a98d6-9b51-4575-9649-77cbfb1f5f1c for instance 2d879744-3a18-481b-a9ec-441278759057 on hv-cinder-maste Oct 19 22:05:03.293839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-de7d506c-b699-431e-be54-51585cea7676 req-4d3a9187-b052-459a-8cae-34c806aee249 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054054 Oct 19 22:05:03.294833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 234/491] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:03.421032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:03.422044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:03.430156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.430473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.430999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.431625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.432247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.432674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.491518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:03.492560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:03.502501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.504342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.504816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.506239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.506917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.508718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.536630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:03.550939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-793ef71e-06d8-4256-a15e-21e29ff67a58 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/ips" status: 200 len: 146 microversion: 2.1 time: 0.064924 Oct 19 22:05:03.551553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 235/492] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:05:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/ips => generated 146 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:03.558029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=16 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:03.612261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:03.621084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4c1e356d-3953-4ed3-a804-9b631adeeba3 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.204178 Oct 19 22:05:03.622236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 258/493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:03 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:03.952947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:03.957932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:03.966844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.967565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.971180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:03.971180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:03.971180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:03.971180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.092279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:04.093224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:04.106885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.107404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.107839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.108550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.113356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.113795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.187470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:04.200276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:04.203420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:04.204942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3c5fb0e-fac1-4be5-84c7-0c0d4b089eb7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.258713 Oct 19 22:05:04.206191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 236/494] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:04.259964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:04.260852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:04.270493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.283845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.284581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.285465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.286045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.286587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.292781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:04.330291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:04.339738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ad37ec8d-39e0-4ce7-a877-b5d4c693b79a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.253781 Oct 19 22:05:04.340933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 259/495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:04 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:04.373086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:04.382932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:04.392833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.393575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.396548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.398177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.398800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.400727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.540103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:04.549972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3df4af39-7295-48f3-ba6b-8e4dd0e7ec92 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.293676 Oct 19 22:05:04.550882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 237/496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:04 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:04.559174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-1dcf546a-214e-4f2f-8a6c-3e760b18ff0a req-152575af-da13-485c-8dbf-0643c5b1b176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e0e488-cb92-478d-8aa4-357c3773dedc", "tag": "0cb10885-0f37-4381-a5f7-eebc5f05f951"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:04.580861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-1dcf546a-214e-4f2f-8a6c-3e760b18ff0a req-152575af-da13-485c-8dbf-0643c5b1b176 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.581718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-1dcf546a-214e-4f2f-8a6c-3e760b18ff0a req-152575af-da13-485c-8dbf-0643c5b1b176 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.582374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-1dcf546a-214e-4f2f-8a6c-3e760b18ff0a req-152575af-da13-485c-8dbf-0643c5b1b176 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.596428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-1dcf546a-214e-4f2f-8a6c-3e760b18ff0a req-152575af-da13-485c-8dbf-0643c5b1b176 service nova] Creating event network-changed:0cb10885-0f37-4381-a5f7-eebc5f05f951 for instance 47e0e488-cb92-478d-8aa4-357c3773dedc on hv-cinder-maste Oct 19 22:05:04.602672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-1dcf546a-214e-4f2f-8a6c-3e760b18ff0a req-152575af-da13-485c-8dbf-0643c5b1b176 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050396 Oct 19 22:05:04.603908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 238/497] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:04.636858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:04.645570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7f96dcf2-a4ee-4d6e-9f5e-62108fedc92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.276984 Oct 19 22:05:04.646158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 260/498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:04.665718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:04.666417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:04.673402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.674133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.687043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.688224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:04.688716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:04.689156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:04.853347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:04.863769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7ff947ea-09d8-4dd1-b9b1-8649a0e996d7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.202495 Oct 19 22:05:04.867524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 239/499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:04 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:05.234016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:05.234541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:05.243533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.246357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.250205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.250981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.251438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.251861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.363358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=14 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:05.370320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:05.371923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:05.384914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.387846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.388803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.389115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.390789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.391265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.493910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:05.504509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:05.507282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:05.508910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8254bfc-13f3-404b-b6ac-5a86575a7903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.279252 Oct 19 22:05:05.541749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 261/500] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:05.573568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:05.574229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:05.586366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.587314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.588026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.588986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.589659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.590295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.633817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:05.643228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-422d57dd-465a-41ac-9fe7-67ae7406656c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.284059 Oct 19 22:05:05.644464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 240/501] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:05 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:05.670624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:05.671568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:05.688285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.689043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.689639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.690516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.691164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.691747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.868085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:05.877846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b414a278-c4bc-408b-ac2b-eede98cb4713 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.308862 Oct 19 22:05:05.891205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 262/502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:05 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:05.894973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:05.900044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:05.914189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.914694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.915170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.915893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:05.916352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:05.916779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:05.925766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:05.939869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ce433f4e-ada4-471a-a9da-c9f9da8ba8f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.273151 Oct 19 22:05:05.955553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 241/503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:06.111211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:06.121231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-caa56756-2132-4352-a6f5-f144410fe0fb tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.230056 Oct 19 22:05:06.123462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 263/504] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:05 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:06.508876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfa0bff0-e86f-4838-936f-0fbbd5315a79"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:06.511438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:06.518206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.518704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.519179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:06.519982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.520441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.520870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:06.540703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:06.541408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:06.550095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.554854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.555376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:06.556330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.556988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.557593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:06.707128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:06.715655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:06.717121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:06.718352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ddf1114b-8eeb-41f5-895e-a501f7736908 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.182224 Oct 19 22:05:06.718905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 264/505] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:06.723765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:06.724578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:06.732158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.732852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.733732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:06.735376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.736351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.740122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:06.881421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:06.889730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-66ab42c2-7ab8-4fb5-a545-6e893c75b1da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.169310 Oct 19 22:05:06.890307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 265/506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:06 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:06.905310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:06.906227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:06.916446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.917394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.918079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:06.918910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:06.919493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:06.920011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.285202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:07.293162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-26c2cf98-e54d-4d61-ac0d-bded1427907d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.391428 Oct 19 22:05:07.293947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 266/507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:06 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:07.313097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:07.313698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:07.320183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.320657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.321087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.321773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.322223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.322646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.466060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:07.473799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a28b54d1-3657-486c-9840-6db8328493e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.164541 Oct 19 22:05:07.474365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 267/508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:07.478936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:07.479566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:07.485196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.485679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.486114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.486802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.487282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.487706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.630692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:07.639490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4e5ce61c-efe7-4bf1-8878-6d097163012f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.164007 Oct 19 22:05:07.640372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 268/509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:07 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:07.746168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:07.746874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:07.753327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.753928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.754457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.755284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.755848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.756365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.778154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:07.904724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:07.917057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:07.920516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:07.921843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c75fba82-c929-46f4-adcc-a52b872c68d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.180718 Oct 19 22:05:07.929989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 269/510] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:07.929989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:07.929989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:07.935327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.936024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.936561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:07.937358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:07.937919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:07.938449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.081202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:08.092658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ae4698be-50a2-4624-95ce-c7ce5736f9f1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.169033 Oct 19 22:05:08.093940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 270/511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:07 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:08.315963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:08.316613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:08.318468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:08.323671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.324176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.324616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.325331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.325790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.326216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.469667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:08.481695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f6ea3e48-7d32-42d5-a171-018dba68d9c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.169371 Oct 19 22:05:08.486566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 271/512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:08 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:08.498310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:08.498972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:08.505725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.506236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.507021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.507743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.508204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.508634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.650450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:08.705078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e0a12889-bb44-41da-a410-ea6cbed1b102 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.164855 Oct 19 22:05:08.705078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 272/513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:08.705078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:08.705078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:08.705078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.705545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.705545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.705545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.705545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.705862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.856534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:08.864824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-910dd959-9628-4a6c-9198-db9f30c26bcd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.203037 Oct 19 22:05:08.866334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 273/514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:08 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:08.948971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:08.951452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:08.956176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.956660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.957101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:08.957793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:08.958252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:08.958679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.097580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:09.106528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:09.107902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:09.109050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-92cf5bc3-57c4-4593-a493-dd4a89ef0bd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.164602 Oct 19 22:05:09.109602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 274/515] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:09.115750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:09.116473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:09.122125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.122788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.123243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.123986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.124506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.125038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.286232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:09.294465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-76e15519-9e55-499c-a07f-34d7da8e5481 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.181993 Oct 19 22:05:09.295204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 275/516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:09 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:09.505377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:09.506108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:09.513331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.513984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.514493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.515376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.515993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.516490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.653878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:09.664198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b977ee20-db96-4b58-b419-4f9bbac444cb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.162661 Oct 19 22:05:09.670370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 276/517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:09 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:09.724565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:09.725239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:09.731854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.732342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.732776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.733470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.733924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.734353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.877499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:09.885572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf0a578d-db6e-468b-9900-7962a8ac3d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.165244 Oct 19 22:05:09.886143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 277/518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:09.890620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:09.891264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:09.897158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.898190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.898638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:09.899380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:09.899831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:09.900259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.052212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:10.061793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-669dca5b-3beb-48c6-bc7a-281eaf450e24 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.174587 Oct 19 22:05:10.062538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 278/519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:09 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:10.134719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:10.135385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:10.141834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.142435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.142991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.143852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.144425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.144947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.294146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:10.304682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:10.306719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:10.308046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-394fde1d-1bd4-49c1-836d-a15fa6403f9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.177641 Oct 19 22:05:10.311025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 279/520] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:10.320642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:10.322421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:10.327356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.327842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.328282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.328964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.329417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.329838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.477485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:10.485291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9628070a-f4bd-4996-96b7-c9d91cff2431 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.168977 Oct 19 22:05:10.486076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 280/521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:10 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:10.687803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:10.688785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:10.698641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.699981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.700636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.701363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.701822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.702237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.837693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:10.845335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6766ea89-a70d-485a-8217-2dcc48065667 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.161850 Oct 19 22:05:10.845896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 281/522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:10 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:10.909167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:10.909779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:10.915693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.916188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.916601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:10.917288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:10.917739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:10.918159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.046828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:11.054732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-13f35d34-3c52-45ee-b7cd-88b2404a4019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.149394 Oct 19 22:05:11.055316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 282/523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:11.083677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:11.084282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:11.089752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.090234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.090671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.091392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.091844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.092266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.221698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:11.229706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a7526371-187b-45f1-b4a2-35efd9d804b7 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.149500 Oct 19 22:05:11.230208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 283/524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:11 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:11.334235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:11.334980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:11.340930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.345979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.345979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.345979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.345979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.346325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.471201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:11.480380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:11.482043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:11.483269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e624a447-e1c1-4d90-9495-707e97a527bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.152855 Oct 19 22:05:11.485194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 284/525] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:11.508299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:11.508973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:11.514905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.515417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.515851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.516585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.516998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.517446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.648812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:11.656436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-304a5882-b51e-415b-9549-24946ae5b3da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.151847 Oct 19 22:05:11.656991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 285/526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:11 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:11.867889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:11.868532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:11.874918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.875426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.875857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.876547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:11.876999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:11.877422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:11.881381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:12.004906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:12.013410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2be98f2e-fa3d-4dcc-b691-499830280341 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.148945 Oct 19 22:05:12.013529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 286/527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:11 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:12.077263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:12.077875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:12.083692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.084181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.084615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.085944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.086400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.086829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.215269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:12.223027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-940939fa-3a7a-4788-9608-f219efde3099 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.149394 Oct 19 22:05:12.223596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 287/528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:12.252494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:12.253030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:12.259502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.259983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.260417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.261103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.261563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.261984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.387775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:12.395259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ee717ed7-84b0-4558-918f-427c22d7ec48 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.146499 Oct 19 22:05:12.395844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 288/529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:12 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:12.509162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:12.509533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:12.516145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.516625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.517057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.517751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.518203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.518626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.648142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:12.656917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:12.658361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:12.659562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ec620582-ca2a-414b-b33f-f8f7060eefb1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.154911 Oct 19 22:05:12.660122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 289/530] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:12.681538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:12.682152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:12.688301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.688793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.689231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.689941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:12.690396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:12.690824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:12.828224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:12.836011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9459885-dc32-49fd-82e3-3b76a64d153f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.159484 Oct 19 22:05:12.836581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 290/531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:12 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:13.036234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:13.036884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:13.043806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.044294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.044733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.045439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.045896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.046325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.185401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:13.193395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-28ee1274-0652-4d93-8c94-0a71928bfdc9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.161101 Oct 19 22:05:13.193976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 291/532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:13 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:13.246364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:13.246933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:13.252917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.253572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.255088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.255811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.256280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.256703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.485129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:13.492621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6209e929-c088-4286-a812-d0eaf614796b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.250309 Oct 19 22:05:13.493191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 292/533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:13.497714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:13.501274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:13.504086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.504612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.505055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.505746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.506197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.506622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.714867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:13.722755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f4788b3d-3299-41fa-90c6-e31643bba74c tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.228580 Oct 19 22:05:13.738279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 293/534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:13 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:13.738279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:13.738279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:13.738279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.738641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.738641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.738641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.738641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.738914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.882277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:13.890724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:13.892195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:13.893349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9422d48b-72c4-4971-b842-17d77832754a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.168923 Oct 19 22:05:13.893909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 294/535] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:13.905839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:13.911211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:13.912389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.912981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.914053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:13.914757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:13.915245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:13.915666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.140680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:14.148845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a9bc9379-5bff-4fd3-942e-5d23c10e0081 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1313 microversion: 2.1 time: 0.247042 Oct 19 22:05:14.149421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 295/536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:13 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:14.217234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:14.217850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:14.223677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.224189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.224622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.225318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.225772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.226198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.398775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:14.409483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e3302f6f-4e51-44c0-947d-9c9479301619 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.195313 Oct 19 22:05:14.410869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 296/537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:14 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:14.416093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-47c580c4-2def-49bc-a56b-18cf5689534f req-1ad271a8-951d-42e7-8808-b125e7284484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9df3c36-da16-4a07-b4a2-c426787bd720", "tag": "153fb256-a786-4d57-9050-0204c6241145"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:14.428689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-47c580c4-2def-49bc-a56b-18cf5689534f req-1ad271a8-951d-42e7-8808-b125e7284484 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.429725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-47c580c4-2def-49bc-a56b-18cf5689534f req-1ad271a8-951d-42e7-8808-b125e7284484 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.430148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-47c580c4-2def-49bc-a56b-18cf5689534f req-1ad271a8-951d-42e7-8808-b125e7284484 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.453995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-47c580c4-2def-49bc-a56b-18cf5689534f req-1ad271a8-951d-42e7-8808-b125e7284484 service nova] Creating event network-changed:153fb256-a786-4d57-9050-0204c6241145 for instance a9df3c36-da16-4a07-b4a2-c426787bd720 on hv-cinder-maste Oct 19 22:05:14.459483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-47c580c4-2def-49bc-a56b-18cf5689534f req-1ad271a8-951d-42e7-8808-b125e7284484 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047347 Oct 19 22:05:14.460134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 297/538] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:14.516057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:14.516761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:14.522842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.523382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.523823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.524525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.525006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.525434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.652696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:14.660275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a52127f-d0e4-4c87-b007-03916ce9e824 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.148578 Oct 19 22:05:14.660839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 298/539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:14.744979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:14.745577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:14.751364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.751847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.752281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.752964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.753415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.753836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.895016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:14.902884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f8d96dbc-dc7a-46c4-be85-ffef5f89cffd tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.161955 Oct 19 22:05:14.903460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 299/540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:14 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:14.919136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:14.919740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:14.925518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.926009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.926444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:14.927174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:14.927626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:14.928049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.181153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:15.189612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:15.191474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:15.192620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-53c4ea78-337d-47fd-9161-a6ebe05c7de0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.277310 Oct 19 22:05:15.193182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 300/541] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:15.197747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:15.198349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:15.204577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.205378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.205803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.206484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.206929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.207365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.344228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:15.352798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69e5d626-1fcb-4565-b09f-b201bae16006 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1497 microversion: 2.1 time: 0.158592 Oct 19 22:05:15.367396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 301/542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:15 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:15.438863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:15.440944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:15.449276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.449947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.450649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.451850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.452580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.453198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.575383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-87366ad9-447e-4603-986c-2ff187fb6b22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.070330 Oct 19 22:05:15.591585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 242/543] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:05:06 2022] POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 194 bytes in 9086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:05:15.687852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:15.689010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:15.713662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.716307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.716307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.718120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.719231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.720294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.875655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:15.891021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f896d05d-3ef0-4f42-9c0d-487042e54c17 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.453387 Oct 19 22:05:15.891021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 302/544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:15 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:15.928510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:15.929677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:15.936381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.936819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.937568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.938324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:15.939310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:15.939758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:15.962073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:16.002128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:16.012158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-501409a7-1472-49eb-8ae9-f69b5a8ae487 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.331910 Oct 19 22:05:16.012735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 243/545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:16.087664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:16.095229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7c20c7cd-77ef-4a14-9793-be62bf331bb0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.172872 Oct 19 22:05:16.095844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 303/546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:15 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:16.217768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:16.218374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:16.224972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.225433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.225830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:16.229830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.230310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.230745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:16.300517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:16.302338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:16.310066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.310596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.311062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:16.311793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.312468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.313085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:16.339239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Going to try to terminate instance {{(pid=121022) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:05:16.374718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:16.383804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:16.385427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:16.392585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4c8bfbf8-8a85-4418-85de-164e4a85b6ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.172892 Oct 19 22:05:16.392585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 244/547] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:16.593358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f99c9ebe-5bd8-44fe-8753-5b7462bc74a9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 204 len: 0 microversion: 2.1 time: 0.296817 Oct 19 22:05:16.593943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 304/548] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:05:16 2022] DELETE /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 22:05:16.602351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:16.602988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:16.608986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.609467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.609903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:16.610588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.611072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.611514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:16.738517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:16.746137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0fccae28-019c-43d0-878a-e9aaa9716825 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1503 microversion: 2.1 time: 0.148040 Oct 19 22:05:16.746701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 245/549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:16 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:16.917849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:16.918556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:16.924408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.924898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.925337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:16.926034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:16.926493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:16.926921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.036855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:17.037470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:17.043840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.044237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.044672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.045378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.045828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.046251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.278278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:17.290550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5def6650-7d0a-41c5-b717-f310ed872a93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.257049 Oct 19 22:05:17.299374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 246/550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:17.301279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:17.302141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:17.310274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.310777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.311283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.311997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.313054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.313495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.447761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:17.455439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-13bc5a3b-840a-4fa0-8089-18909d8c0684 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.158548 Oct 19 22:05:17.456886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 247/551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:17 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:17.460884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:17.461601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:17.465686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:17.467603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.468289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.468727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.469421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.470031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.470623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.474064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4d058ce5-a6af-47dc-8315-27117551658a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.560998 Oct 19 22:05:17.474709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 305/552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:16 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:17.597501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:17.606392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:17.607868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:17.609066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e5eb2639-02f7-4b17-9b2b-b42dc8768d1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.152008 Oct 19 22:05:17.609634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 248/553] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:17.768843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:17.769449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:17.775680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.776159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.776589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.777274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:17.777723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:17.778141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:17.905097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:17.912762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c6128c69-b1d7-4f0e-b44a-66f555f09f4c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1503 microversion: 2.1 time: 0.147681 Oct 19 22:05:17.913323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 306/554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:17 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:18.313935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:18.314554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:18.320985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.321471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.321911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.322609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.323093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.323516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.461841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:18.467917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9cc3d7e9-a5e8-41c0-98b5-60cf5b83fe98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.157985 Oct 19 22:05:18.468502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 249/555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:18.477966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:18.478663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:18.484871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.485400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.486563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.486563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.487097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.487533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.497161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:18.497891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:18.504160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.504656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.505268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.506037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.506555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.507132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.673051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:18.684040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a7b9cad7-6ef4-48e4-99fa-6f41d302aa9b tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.209664 Oct 19 22:05:18.685471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 307/556] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:18 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:18.691143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-57fc240b-09a8-4422-864f-b26330d908aa req-ca50ad1b-87a9-47a2-a0ee-6dd109ea4878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3772e1d-c468-46b9-95cf-d21bb0e427b6", "name": "network-vif-plugged", "status": "completed", "tag": "7db273b8-393f-4339-88f8-17078884c016"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:18.702326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-57fc240b-09a8-4422-864f-b26330d908aa req-ca50ad1b-87a9-47a2-a0ee-6dd109ea4878 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.702933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-57fc240b-09a8-4422-864f-b26330d908aa req-ca50ad1b-87a9-47a2-a0ee-6dd109ea4878 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.703694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-57fc240b-09a8-4422-864f-b26330d908aa req-ca50ad1b-87a9-47a2-a0ee-6dd109ea4878 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.716209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-57fc240b-09a8-4422-864f-b26330d908aa req-ca50ad1b-87a9-47a2-a0ee-6dd109ea4878 service nova] Creating event network-vif-plugged:7db273b8-393f-4339-88f8-17078884c016 for instance c3772e1d-c468-46b9-95cf-d21bb0e427b6 on hv-cinder-maste Oct 19 22:05:18.721346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-57fc240b-09a8-4422-864f-b26330d908aa req-ca50ad1b-87a9-47a2-a0ee-6dd109ea4878 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034608 Oct 19 22:05:18.722017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 308/557] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:18.728618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:18.736098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:18.736098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.736697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.737623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.737874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.738546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.738987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.753789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:18.763111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b8fd9806-ce9d-4c52-8b86-1ce45fdf7620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.269776 Oct 19 22:05:18.763966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 250/558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:18 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:18.889315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:18.897765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:18.899228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:18.900386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0bbe5d03-9e44-43d7-96e4-53f144d40ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.177068 Oct 19 22:05:18.900945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 309/559] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:18.936760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:18.937580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:18.943805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.944381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.944969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:18.946314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:18.946995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:18.947708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.076671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:19.084482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c0d23bd2-9cbb-4c33-b5e5-4eba023d00e0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1503 microversion: 2.1 time: 0.151506 Oct 19 22:05:19.085251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 251/560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:18 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:19.491256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:19.491869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:19.498896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.499409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.499840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.500523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.501004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.501424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.626534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:19.634142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-600c8593-f246-4f86-a385-c371a075f13e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.146782 Oct 19 22:05:19.634704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 310/561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:19.706148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:19.706758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:19.713676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.714158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.714597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.715308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.715764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.716186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.802370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:19.802980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:19.810328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.810466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.811172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.812047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.812581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.813070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.924060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:19.933541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e6c353f4-dae9-459a-bad8-b7c3f8601136 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.231085 Oct 19 22:05:19.947102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 252/562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:19 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:19.954589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:19.955485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:19.963242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.964120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.964785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.965510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:19.966216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:19.966590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:19.971272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:20.202093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:20.210318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d373a953-9d1f-440b-9c00-4f9c7e7f5fec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.422039 Oct 19 22:05:20.216137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:20.220679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 311/563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:19 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:20.227168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:20.227605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:20.227845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:20.229297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:20.230620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3cb0e733-d594-4820-b4be-c5a54331c0fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1753 microversion: 2.20 time: 0.282255 Oct 19 22:05:20.231206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 253/564] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1753 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:20.234059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.234533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.235022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:20.235729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.236183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.236606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:20.545069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:20.552718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-13786cd0-66d4-4ae0-bb93-11708af09b92 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1503 microversion: 2.1 time: 0.330946 Oct 19 22:05:20.553877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 312/565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:20 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:20.657464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:20.658156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:20.664426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.665018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.665515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:20.666270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.666810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.667319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:20.737441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-275ebcfe-4472-4c3a-9876-db1e1a3f7102 req-4f2c98e8-9eda-470b-a549-9e2c4329984f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d879744-3a18-481b-a9ec-441278759057", "name": "network-vif-plugged", "status": "completed", "tag": "d55a98d6-9b51-4575-9649-77cbfb1f5f1c"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:20.748473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-275ebcfe-4472-4c3a-9876-db1e1a3f7102 req-4f2c98e8-9eda-470b-a549-9e2c4329984f service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.748961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-275ebcfe-4472-4c3a-9876-db1e1a3f7102 req-4f2c98e8-9eda-470b-a549-9e2c4329984f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.749410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-275ebcfe-4472-4c3a-9876-db1e1a3f7102 req-4f2c98e8-9eda-470b-a549-9e2c4329984f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:20.761595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-275ebcfe-4472-4c3a-9876-db1e1a3f7102 req-4f2c98e8-9eda-470b-a549-9e2c4329984f service nova] Creating event network-vif-plugged:d55a98d6-9b51-4575-9649-77cbfb1f5f1c for instance 2d879744-3a18-481b-a9ec-441278759057 on hv-cinder-maste Oct 19 22:05:20.766546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-275ebcfe-4472-4c3a-9876-db1e1a3f7102 req-4f2c98e8-9eda-470b-a549-9e2c4329984f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 Oct 19 22:05:20.770017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 313/566] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:05:20.821422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:20.830778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ce2e12e2-bda7-4309-af6f-4fb681c600ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.177201 Oct 19 22:05:20.831600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 254/567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:20.912365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-98309ea0-089e-4b9b-8eb5-cae2d781b2ce req-0abf2bc0-5474-43f3-bd60-cd0170e1dd10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c839cebb-9e6d-4a76-9f23-858d73e7ff65", "name": "network-vif-deleted", "tag": "532331de-7c0b-4f50-b5c7-4fbc9aebc34b"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:20.923496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-98309ea0-089e-4b9b-8eb5-cae2d781b2ce req-0abf2bc0-5474-43f3-bd60-cd0170e1dd10 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.923973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-98309ea0-089e-4b9b-8eb5-cae2d781b2ce req-0abf2bc0-5474-43f3-bd60-cd0170e1dd10 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.924394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-98309ea0-089e-4b9b-8eb5-cae2d781b2ce req-0abf2bc0-5474-43f3-bd60-cd0170e1dd10 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:20.936604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-98309ea0-089e-4b9b-8eb5-cae2d781b2ce req-0abf2bc0-5474-43f3-bd60-cd0170e1dd10 service nova] Creating event network-vif-deleted:532331de-7c0b-4f50-b5c7-4fbc9aebc34b for instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 on hv-cinder-maste Oct 19 22:05:20.942103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-98309ea0-089e-4b9b-8eb5-cae2d781b2ce req-0abf2bc0-5474-43f3-bd60-cd0170e1dd10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034024 Oct 19 22:05:20.942704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 314/568] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:20.958568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:20.959388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:20.965582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.966071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.966512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:20.967231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:20.967693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:20.968200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.105565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:21.113378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d80202e1-e163-49f7-9641-a7524ce8a25f tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.158692 Oct 19 22:05:21.113938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 255/569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:20 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:21.234453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:21.235181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:21.241291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.241776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.242220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.242911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.243393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.243818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.255281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:21.255885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:21.261834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.262319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.262753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.263467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.263922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.264352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.400519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:21.411627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:21.413895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:21.415781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-05c8c18f-cd0c-469a-98f9-1931bb245456 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.164325 Oct 19 22:05:21.416427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 256/570] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:21.438744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:21.448757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8d7a862f-6aa7-463c-9f96-5ae5570e9d8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1318 microversion: 2.1 time: 0.218527 Oct 19 22:05:21.449319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 315/571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:21 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:21.577406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:21.578050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:21.583909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.584393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.584830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.585526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.585983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.587017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.616841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.617325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.617758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.618202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lazy-loading 'fault' on Instance uuid c839cebb-9e6d-4a76-9f23-858d73e7ff65 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:05:21.657879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:21.665511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-53426269-25f0-47f8-80d4-80aebc30a891 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1303 microversion: 2.1 time: 0.092182 Oct 19 22:05:21.666106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 257/572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:21 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:21.853525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:21.854218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:21.860637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.861113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.861543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.862224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:21.862690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:21.863152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:21.997807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:22.005540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c301bba1-3da9-4f62-8160-02ee56656327 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.155778 Oct 19 22:05:22.011552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 316/573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:22.136952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:22.137553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:22.143846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.144334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.144769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.145459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.145913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.146336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.274409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:22.282215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8f7bec49-02cc-4ec4-a428-2a4d1045bcce tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.149558 Oct 19 22:05:22.282979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 258/574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:22 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:22.442471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:22.442882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:22.448886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.449366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.449801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.450502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.450983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.451410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.470942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:22.471812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:22.478589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.479135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.479612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.480347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.480808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.481237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.584774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:22.593341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:22.594785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:22.595980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82aa0c7f-f3ce-487c-b820-08bba326176e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.157662 Oct 19 22:05:22.596540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 317/575] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:22.615387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:22.623601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ecf1e42a-bc20-4506-9e0e-8f81dbc0f383 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1507 microversion: 2.1 time: 0.156384 Oct 19 22:05:22.624165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 259/576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:22 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:22.645568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10cd57fb-063a-4448-b9a2-b6be724233c5", "device": "/dev/sdb"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:22.649052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:22.651012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:22.655677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.656157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.656590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.657275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.657792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.658219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.688361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:22.688964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:22.695045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.695530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.695966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.696656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.697102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.697523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.729417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:22.729850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:22.730280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:22.730715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lazy-loading 'fault' on Instance uuid c839cebb-9e6d-4a76-9f23-858d73e7ff65 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:05:22.769611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:22.777626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-11bb3429-1648-4451-95d8-b085e950b8d1 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1303 microversion: 2.1 time: 0.093130 Oct 19 22:05:22.778183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 260/577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:22 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:23.029174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:23.029771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:23.035683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.036158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.036674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.037320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.037768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.038187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.165413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:23.173005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7680f052-6093-4490-9476-0ce78bcebf88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.147707 Oct 19 22:05:23.173565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 261/578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:23.307986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:23.308349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:23.314823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.315358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.315789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.316518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.316966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.317383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.444474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:23.453993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b5dd5dba-70bc-41ef-9916-f81ae7ff57ec tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1370 microversion: 2.1 time: 0.151246 Oct 19 22:05:23.454617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 262/579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:23 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:23.622125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:23.622648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:23.628557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.632039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.632039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.632039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.632039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.632449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.763083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:23.771524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:23.772952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:23.774178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2f5f6ca9-436d-4690-82d3-23cc5d861c98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.156515 Oct 19 22:05:23.774727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 263/580] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:23.799970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:23.800664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:23.807586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.808065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.808496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.809187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.809786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.810206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.839665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:23.840137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:23.840569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:23.841004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lazy-loading 'fault' on Instance uuid c839cebb-9e6d-4a76-9f23-858d73e7ff65 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:05:23.884134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:23.903125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5ddc3105-a1fe-4a13-97d5-185d31267169 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1303 microversion: 2.1 time: 0.106879 Oct 19 22:05:23.906816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 264/581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:23 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:24.195724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:24.196283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:24.202666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.203189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.203621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.204309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.204759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.205178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.346013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:24.355318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9af017da-48bd-4f64-96f8-23a4fb9d989f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.163275 Oct 19 22:05:24.356869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 265/582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:24.409820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1a8aae3a-6594-4c74-aa3c-4f120be86620 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "POST /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.768086 Oct 19 22:05:24.410466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 318/583] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:05:22 2022] POST /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6/os-volume_attachments => generated 194 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:05:24.476470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:24.477689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:24.486413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.486917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.487737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.488465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.488928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.489366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.616715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-d13ba486-5899-45d7-833c-78bf550bbf61 req-97ddffad-c79e-4da4-a02c-526134337ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9df3c36-da16-4a07-b4a2-c426787bd720", "name": "network-vif-plugged", "status": "completed", "tag": "153fb256-a786-4d57-9050-0204c6241145"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:24.624112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:24.627096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-d13ba486-5899-45d7-833c-78bf550bbf61 req-97ddffad-c79e-4da4-a02c-526134337ca4 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.627579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-d13ba486-5899-45d7-833c-78bf550bbf61 req-97ddffad-c79e-4da4-a02c-526134337ca4 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.628007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-d13ba486-5899-45d7-833c-78bf550bbf61 req-97ddffad-c79e-4da4-a02c-526134337ca4 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.631666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f4ce792a-18e0-47f7-9d4c-faee9daf3299 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1564 microversion: 2.1 time: 0.159011 Oct 19 22:05:24.631814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:24.633417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 266/584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:24 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:24.640377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-d13ba486-5899-45d7-833c-78bf550bbf61 req-97ddffad-c79e-4da4-a02c-526134337ca4 service nova] Creating event network-vif-plugged:153fb256-a786-4d57-9050-0204c6241145 for instance a9df3c36-da16-4a07-b4a2-c426787bd720 on hv-cinder-maste Oct 19 22:05:24.645461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-d13ba486-5899-45d7-833c-78bf550bbf61 req-97ddffad-c79e-4da4-a02c-526134337ca4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Oct 19 22:05:24.646033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 319/585] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:05:24.654872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:24.655433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:24.661263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.661742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.662175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.662858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.663345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.663768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.740714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e801d79d-a360-4bfd-b37f-672664306f4e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089559 Oct 19 22:05:24.741312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 267/586] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 19 22:05:24 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:24.800595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:24.801287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:24.808329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.808809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.809245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.809932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.810386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.810833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.927558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:24.930699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:24.941387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.942055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.942594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:24.943835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:24.945008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:24.946009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:25.003240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:25.004145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:25.005370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:25.006247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lazy-loading 'fault' on Instance uuid c839cebb-9e6d-4a76-9f23-858d73e7ff65 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:05:25.020956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:25.029964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:25.031426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:25.032621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-22480570-d0c4-41b0-9f49-33a8b1f3c464 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.236302 Oct 19 22:05:25.033344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 320/587] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:25.079531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:25.087304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:25.092437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-171bb5b3-de81-4ddd-97db-0bf59c7940f5 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 200 len: 1303 microversion: 2.1 time: 0.169294 Oct 19 22:05:25.093021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 268/588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:24 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:25.380100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:25.387387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:25.387734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:25.388231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:25.388664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:25.389781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:25.390235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:25.390727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:25.612947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:25.621495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-263a5538-c4be-4718-b58a-56d91aa876f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.245709 Oct 19 22:05:25.622409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 321/589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:26.058550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:26.059240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:26.075585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.076087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.076530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:26.077242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.077696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.078122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:26.109056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-c1a666fd-3aa2-48ed-9650-ac56d0261965 req-97948dab-0ed7-4848-9ec9-f933d6da2c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d879744-3a18-481b-a9ec-441278759057", "tag": "d55a98d6-9b51-4575-9649-77cbfb1f5f1c"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:26.114332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-c1a666fd-3aa2-48ed-9650-ac56d0261965 req-97948dab-0ed7-4848-9ec9-f933d6da2c61 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.114897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-c1a666fd-3aa2-48ed-9650-ac56d0261965 req-97948dab-0ed7-4848-9ec9-f933d6da2c61 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.115435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-c1a666fd-3aa2-48ed-9650-ac56d0261965 req-97948dab-0ed7-4848-9ec9-f933d6da2c61 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:26.127249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-c1a666fd-3aa2-48ed-9650-ac56d0261965 req-97948dab-0ed7-4848-9ec9-f933d6da2c61 service nova] Creating event network-changed:d55a98d6-9b51-4575-9649-77cbfb1f5f1c for instance 2d879744-3a18-481b-a9ec-441278759057 on hv-cinder-maste Oct 19 22:05:26.132451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-c1a666fd-3aa2-48ed-9650-ac56d0261965 req-97948dab-0ed7-4848-9ec9-f933d6da2c61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031728 Oct 19 22:05:26.134071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 322/590] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:05:26.139372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:26.140972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: c839cebb-9e6d-4a76-9f23-858d73e7ff65] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:26.147955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.149196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.149738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:26.150565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.151189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.151721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:26.166452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] HTTP exception thrown: Instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 could not be found. Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Request method failure captured: Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 HTTP/1.1 Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHRodLZM7DeQy029RYqjqF7wlVQRSCfb5WOVdtEeKJGwb8wyeN-_2-25owp5RWxYStUt6wFLCcu9-q1DRTyQYHDIW5hj-yMWr3UUtUBEAT-5doMPWwLRHCYgObui7xDUuciDmTbpWxdzuBKGVRjSK3Mibxu7Rx2ZdS4IhiQj0vWXtVQ Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: bbf0f765079a44bc9e68012054763b34 Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesActionsTest-1525443205 Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:05:26.168485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbf0f765079a44bc9e68012054763b34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbf0f765079a44bc9e68012054763b34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbf0f765079a44bc9e68012054763b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbf0f765079a44bc9e68012054763b34"}]}] Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesActionsTest-1525443205 Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: bbf0f765079a44bc9e68012054763b34 Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesActionsTest-1525443205 Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesActionsTest-1525443205-project Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: e92dd14e2eff4cc0a256708fba70c09d Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesActionsTest-1525443205-project Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 could not be found. Oct 19 22:05:26.170105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': 'c839cebb-9e6d-4a76-9f23-858d73e7ff65'} Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 could not be found. Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:05:26.171056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 could not be found. Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 could not be found. Oct 19 22:05:26.172433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:05:26.173706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Returning 404 to user: Instance c839cebb-9e6d-4a76-9f23-858d73e7ff65 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:05:26.173706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-86517298-8f05-4cbf-8d60-4f4a2f2a3027 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65" status: 404 len: 111 microversion: 2.1 time: 0.035944 Oct 19 22:05:26.173706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 323/591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:26 2022] GET /compute/v2.1/servers/c839cebb-9e6d-4a76-9f23-858d73e7ff65 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:05:26.232776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-952853389", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "networks": [{"uuid": "68b1ada2-1ff5-48fa-9777-32447d26a222"}]}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:26.242127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:26.252539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:26.255111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:26.256012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9cc20313-4665-425f-8cce-c550b018ec02 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.201934 Oct 19 22:05:26.256510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 269/592] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:26.289863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] validate_networks() for [('68b1ada2-1ff5-48fa-9777-32447d26a222', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:05:26.513425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a549a012-c685-47d8-9b65-5e36a2d2f807 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:26.519880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a549a012-c685-47d8-9b65-5e36a2d2f807 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.520728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a549a012-c685-47d8-9b65-5e36a2d2f807 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.521261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a549a012-c685-47d8-9b65-5e36a2d2f807 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:26.604562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a549a012-c685-47d8-9b65-5e36a2d2f807 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Going to try to stop instance {{(pid=121021) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 22:05:26.814742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a549a012-c685-47d8-9b65-5e36a2d2f807 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/action" status: 202 len: 0 microversion: 2.1 time: 0.306417 Oct 19 22:05:26.815434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 270/593] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:05:26 2022] POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:05:26.823334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:26.824261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:26.831374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.832043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.832652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:26.833393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:26.833852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:26.834276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:27.014067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:27.022444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-11500be9-9493-4967-90a0-374697539b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1359 microversion: 2.1 time: 0.205683 Oct 19 22:05:27.023218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 271/594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:27.028167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:27.028880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:27.036519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:27.037558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:27.038076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:27.038780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:27.039801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:27.040225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:27.104200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:05:27.104200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:05:27.104200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:05:27.104746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:05:27.105037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:05:27.115244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:27.115795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:27.116407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:27.117174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:27.118162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:27.118580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:27.144922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Getting quotas for project bbf0f765079a44bc9e68012054763b34. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:05:27.151771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Getting quotas for user e92dd14e2eff4cc0a256708fba70c09d and project bbf0f765079a44bc9e68012054763b34. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:05:27.164707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:05:27.167048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:05:27.188996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:27.197771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-80e172ff-dc5f-4f06-9c7a-24d7392c90be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.173465 Oct 19 22:05:27.198456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 272/595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:27.281952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:27.282683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:27.290740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:27.291253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:27.291721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:27.292528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:27.292942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:27.293363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:27.303488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a0e07bd1-a582-4cbb-8d2a-27bba195f2e4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073921 Oct 19 22:05:27.304722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 324/596] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 22:05:27.327457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-54db10ea-8722-47b8-9d08-61e7421a9540 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:27.328128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-54db10ea-8722-47b8-9d08-61e7421a9540 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:27.475619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-54db10ea-8722-47b8-9d08-61e7421a9540 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:27.479444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-54db10ea-8722-47b8-9d08-61e7421a9540 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1213 microversion: 2.1 time: 0.167511 Oct 19 22:05:27.480312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 325/597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:27 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:27.574114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:27.584262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:27.586837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:27.588247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-29b65678-a530-45e1-a92d-33741f56816c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.310225 Oct 19 22:05:27.599587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 273/598] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:28.045570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:28.046432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:28.057978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.063838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.063838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.063838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.063838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.064204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.196654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.205300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1fd3fcf6-d551-40fe-96be-30c55de12b50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1549 microversion: 2.1 time: 0.163503 Oct 19 22:05:28.205876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 326/599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:28.221961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:28.223717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:28.230260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:28.231133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:28.236489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.236489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.236489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.236489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.236874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.236874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.240530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.241255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.241856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.243345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.243962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.244541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.412951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.423860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-820c3a45-5f1f-432f-ba02-070ea7fb7fcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.205959 Oct 19 22:05:28.425007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 274/600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:28.430531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.438591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5824e267-08f1-48df-8534-274731b5a535 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1549 microversion: 2.1 time: 0.212757 Oct 19 22:05:28.439189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 327/601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1549 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:28.468429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:28.473502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.474276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Searching by: {'deleted': False, 'project_id': '6529fcc0c4c4487ab023942957692c3a'} {{(pid=121021) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 22:05:28.481885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.482371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.482856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.483613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.484064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.484488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.503538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:28.504437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:28.514567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.516582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.517118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.517915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.518448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.518943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.580796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.multi_cell_list [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121021) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 22:05:28.589985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.597858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d5735193-5b20-41bb-a374-c4fad02c1072 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.099181 Oct 19 22:05:28.598450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 328/602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:28 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:28.613907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:28.614543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:28.621371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.622980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.622980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.622980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.624304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.624304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.682118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6539fc86-ff15-409c-93ca-c90f60443fb8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217387 Oct 19 22:05:28.682711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 275/603] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Oct 19 22:05:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:28.695910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:28.697040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:28.703403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.704190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.704775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.705624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:28.706244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:28.706931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:28.776483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.785780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.787501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.789607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b0b888fc-6092-48d4-8774-9ca94bcbb127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.178825 Oct 19 22:05:28.790752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 329/604] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:28.883966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:28.892688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b1ceeab0-cb39-4123-b9c7-2842cc5975a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1549 microversion: 2.1 time: 0.200802 Oct 19 22:05:28.893262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 276/605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:29.452631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:29.453292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:29.460637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:29.479617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:29.480665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:29.482595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:29.483352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:29.483882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:29.622266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:29.623840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:29.632342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:29.637341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:29.637341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:29.637341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:29.637341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:29.637815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:29.670758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:29.679501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4154dcf7-0ed0-477e-925f-f8479520a526 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.230749 Oct 19 22:05:29.691611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 330/606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:29.720426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:29.729585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa3593d4-c361-41bf-a56b-350317637f69 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.112174 Oct 19 22:05:29.730154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 277/607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:29 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:29.815869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:29.816478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:29.825291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:29.825786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:29.826215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:29.826919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:29.827715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:29.828309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:29.987222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:29.996607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:30.002403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:30.002403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2f64749-c6d8-4f17-93ae-1384a0b95023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.188016 Oct 19 22:05:30.002403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 331/608] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:30.704216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:30.704907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:30.712112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:30.712649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:30.713136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:30.713926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:30.714544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:30.715055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:30.761442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:30.767553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:30.783256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:30.784019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:30.784668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:30.785569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:30.786163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:30.786731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:30.908692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:30.924739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:30.937519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-023b96b6-40a8-4646-8ff5-3fd309e00948 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.187660 Oct 19 22:05:30.938198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-799a6361-51de-4995-8308-b5119e6507fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.237357 Oct 19 22:05:30.939328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 278/609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:30.939858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 332/610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:30 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:30.962116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b4775d8-6227-4dab-a23c-e67a3d587c2f"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:30.965868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:30.972977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:30.973933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:30.974532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:30.976040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:30.977279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:30.977864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:31.026503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:31.027163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:31.039655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:31.040293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:31.040985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:31.042149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:31.043268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:31.044085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:31.215584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:31.224239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:31.225698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:31.227613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2dfc3383-ee03-4899-b5de-29d29064d71f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.205581 Oct 19 22:05:31.228204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 333/611] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:31.962435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:31.963164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:31.969661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:31.970144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:31.970575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:31.971306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:31.971759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:31.972183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:32.045751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:32.056043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37b28014-5d97-4fc0-9de5-456502365db2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.097071 Oct 19 22:05:32.057215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 334/612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:31 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:32.066419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:32.067208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:32.074039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:32.074523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:32.074992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:32.075772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:32.076248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:32.076668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:32.215610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:32.223745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e3d284c0-fbfe-425e-9916-0c24ef0b58d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.165276 Oct 19 22:05:32.224317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 335/613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:32.255467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:32.256080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:32.262563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:32.263090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:32.263536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:32.264229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:32.264691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:32.265121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:32.412956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:32.422505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:32.423993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:32.425182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-613032b6-a241-41f7-ab3a-fdbf0f18006b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.173675 Oct 19 22:05:32.425747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 336/614] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:33.079680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:33.080368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:33.087181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:33.087670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:33.088103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:33.088796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:33.089247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:33.089664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:33.166942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:33.174485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5d798c39-5a40-43f1-9c68-95743ec7e3af tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.098731 Oct 19 22:05:33.175062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 337/615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:33 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:33.247590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:33.248197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:33.254147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:33.254631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:33.255095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:33.255781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:33.256234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:33.256659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:33.403348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:33.411464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37f97d8f-451d-4393-93cd-1b0f0ea97c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.167705 Oct 19 22:05:33.412023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 338/616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:33.451460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:33.452065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:33.457957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:33.458434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:33.458864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:33.459587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:33.460035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:33.460450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:33.480490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:33.596374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:33.607091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:33.608545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:33.609903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4a9a395d-962c-4e99-aa95-43ee8704246c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.162368 Oct 19 22:05:33.610472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 339/617] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:34.198100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:34.199076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:34.206876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:34.206876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:34.207323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:34.208214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:34.208677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:34.209110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:34.282342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:34.299165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-45cabad0-4f28-47e8-b0d2-283473cb6abf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.098318 Oct 19 22:05:34.300002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 340/618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:34 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:34.435967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:34.436501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:34.442739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:34.443289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:34.443738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:34.444468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:34.444935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:34.445372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:34.586297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:34.594599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-94048990-12b1-482c-bebe-3c18c25edfe7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.162585 Oct 19 22:05:34.595327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 341/619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:34.636779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:34.637380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:34.643336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:34.643813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:34.644238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:34.644915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:34.645363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:34.645807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:34.780952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:34.791514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:34.792959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:34.794176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-437b3575-eff7-4e25-937b-192b3a06b2b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.161406 Oct 19 22:05:34.794734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 342/620] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:35.322901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:35.323633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:35.330343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:35.330846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:35.331512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:35.332766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:35.333489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:35.333960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:35.398539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:35.406663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78e23767-465e-436e-891d-2542cb8d00fa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.088123 Oct 19 22:05:35.407450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 343/621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:35 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:35.620069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:35.620688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:35.627841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:35.628340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:35.628781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:35.629493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:35.629945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:35.630371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:35.772065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:35.781903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3af37bfd-757a-44e3-b7de-e5060f5b196d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.166113 Oct 19 22:05:35.782734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 344/622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:35.821670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:35.822256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:35.828140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:35.828621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:35.829049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:35.829726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:35.830171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:35.830611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:35.969568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:35.978927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:35.980391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:35.981554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-60ac5a33-a2b7-4de8-b123-9d3700546d3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.163894 Oct 19 22:05:35.982109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 345/623] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:36.428782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:36.429528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:36.435765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:36.436253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:36.436694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:36.437384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:36.437843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:36.438269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:36.501212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:36.509433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-46c3834d-626f-4c2c-96a6-f8a49b9db7aa tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.084846 Oct 19 22:05:36.511497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 346/624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:36 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:36.805840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:36.806449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:36.812522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:36.813004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:36.813437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:36.814129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:36.814584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:36.815035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:36.997635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:37.005750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bee1b02a-fa82-402b-bdab-437ddd166176 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.204051 Oct 19 22:05:37.006302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 347/625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:37.011283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:37.011881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:37.017287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:37.017767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:37.018200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:37.018885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:37.019374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:37.019801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:37.126981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:37.203530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:37.211720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:37.213161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:37.214315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7b4c1541-56dd-4bf7-bfaf-63b43d4d1cb0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.207116 Oct 19 22:05:37.214870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 348/626] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:37.532354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:37.532893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:37.535151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=8 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:37.540545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:37.541023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:37.541456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:37.542138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:37.542587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:37.543031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:37.603807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:37.611415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a2e2c50-634b-4f80-96d7-df74603f3fb9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1217 microversion: 2.1 time: 0.082859 Oct 19 22:05:37.611965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 349/627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:37 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:38.029778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:38.030384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:38.036331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:38.036754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:38.037186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:38.037875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:38.038328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:38.038771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:38.168483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:38.177040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9ad1588e-57bb-4e36-865f-b1851b5883f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.151166 Oct 19 22:05:38.177617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 350/628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:38.240188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:38.240899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:38.247533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:38.248066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:38.248662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:38.249427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:38.249956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:38.250449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:38.453758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:38.466659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:38.468164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:38.469974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-043f0526-8ca0-4844-b23b-b0949094e4b4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.234041 Oct 19 22:05:38.470544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 351/629] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:38.516268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:38.634160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:38.634693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:38.641047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:38.641526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:38.641950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:38.642630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:38.643100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:38.643520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:38.705511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:38.712930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed5342fd-d839-4050-b434-d061c41642ee tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1209 microversion: 2.1 time: 0.083300 Oct 19 22:05:38.713485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 352/630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:38 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:39.200470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:39.201077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:39.207063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:39.207651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:39.208083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:39.208759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:39.209212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:39.209627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:39.231784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-694349cb-9573-4e55-aa19-245e62ed07c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.274729 Oct 19 22:05:39.232630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 279/631] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:05:30 2022] POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 194 bytes in 8277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:39.349002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:39.357811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-485ed795-4395-4977-a95b-e71afae0df10 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.161243 Oct 19 22:05:39.358374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 353/632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:39.496128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:39.496824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:39.499479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:39.504259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:39.504745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:39.505183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:39.505881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:39.506333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:39.506757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:39.634169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:39.642847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:39.644320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:39.645480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f985c12d-96a2-48e5-9146-dc979d851cc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.154231 Oct 19 22:05:39.646037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 280/633] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:39.736212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:39.736767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:39.743150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:39.743636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:39.744079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:39.744770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:39.745225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:39.745651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:39.817908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:39.825538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91683f88-dfc6-4757-9a8c-853f55286cfd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1265 microversion: 2.1 time: 0.093116 Oct 19 22:05:39.839145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 354/634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:39 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:40.381755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:40.382365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:40.388842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:40.389331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:40.389766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:40.390451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:40.390906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:40.391356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:40.522054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:40.530291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f42cf651-1db4-47b1-8d89-ab25afc2873a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.152294 Oct 19 22:05:40.530861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 281/635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:40.671742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:40.672502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:40.679436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:40.679918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:40.680474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:40.681333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:40.681881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:40.682412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:40.850727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:40.852146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:40.861692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:40.862186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:40.862621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:40.863763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:40.863876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:40.864203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:40.866805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:40.877319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:40.883805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:40.883805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8f7bfd44-893b-40f4-bc28-4ce71f1d15b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.212654 Oct 19 22:05:40.883805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 355/636] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:40.931650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:40.945155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:40.959235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ff31ff90-5b99-463e-b8bd-85a78ff67fd8 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1273 microversion: 2.1 time: 0.105213 Oct 19 22:05:40.959235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 282/637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:40 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:41.554000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:41.555145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:41.561192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:41.561678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:41.562116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:41.562834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:41.563313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:41.563738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:41.568659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:41.729569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:41.737704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-542a0f38-a315-49a8-938b-d705330cbf92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.187916 Oct 19 22:05:41.738254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 356/638] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:41.906971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:41.907591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:41.914718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:41.915246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:41.915679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:41.916402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:41.916858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:41.917284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:41.980858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:41.981414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:41.987967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:41.988453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:41.988889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:41.990345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:41.990345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:41.990544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:42.048413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:42.058128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:42.059625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:42.060786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e9aa8c35-4dcc-43bf-9fa1-bc9e74cc7297 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.158127 Oct 19 22:05:42.061339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 283/639] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:42.120801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:42.128364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0106bbd7-4b57-40a7-b349-d96e8132de19 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.151929 Oct 19 22:05:42.128922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 357/640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:41 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:42.762281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:42.762877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:42.768879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:42.769345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:42.769780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:42.770465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:42.770916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:42.771361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:42.901161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:42.909306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7793beb1-bfe0-4065-b625-e21b967cf904 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150888 Oct 19 22:05:42.909862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 284/641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:43.085555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:43.086161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:43.092601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:43.093113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:43.093545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:43.094235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:43.094692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:43.095152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:43.150786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:43.151537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:43.157850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:43.158404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:43.158899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:43.159706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:43.160224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:43.160710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:43.222197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:43.231615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:43.233083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:43.234308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-553e9d47-0575-4956-93f9-5f94a60fe9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.152594 Oct 19 22:05:43.234981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 358/642] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:43.293337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:43.301198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1396a5e5-3d22-4fc7-9a5c-cb76aef58b48 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.154241 Oct 19 22:05:43.301772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 285/643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:43 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:43.932566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:43.933181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:43.939246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:43.939728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:43.940159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:43.940842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:43.941293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:43.941717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:44.074211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:44.082543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c8af625a-2b7c-4ee1-9a5f-66aeb0562a79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.154084 Oct 19 22:05:44.083145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 359/644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:44.260615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:44.261210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:44.267677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:44.268160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:44.268590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:44.269277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:44.269753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:44.270228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:44.325289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:44.326472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:44.328918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:44.333850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:44.334547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:44.335189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:44.336562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:44.337189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:44.337610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:44.410313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:44.413910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:44.415571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:44.416731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4258bd58-f826-4014-998f-e8e81547f8e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.160649 Oct 19 22:05:44.417459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 286/645] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:44.563427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:44.572143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b75b2b19-2862-4d65-bfff-218e1d817037 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.250714 Oct 19 22:05:44.572931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 360/646] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:44 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:45.107094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:45.108158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:45.115299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:45.115880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:45.116439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:45.117791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:45.118477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:45.118984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:45.248390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:45.252310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-5a7956d2-3f3f-47b6-a9c5-df282a68f246 req-cb3e0ee1-0418-4b2b-83ae-f34680f2738a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c904f6-2f26-43c8-891a-327e09b6cfef", "tag": "9f67a5bc-0fc9-4c09-868c-0306d466fe9e"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:45.258124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-02211e78-0638-4c94-96c5-a4b3e9fca857 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.155931 Oct 19 22:05:45.258775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 287/647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:45.264548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-5a7956d2-3f3f-47b6-a9c5-df282a68f246 req-cb3e0ee1-0418-4b2b-83ae-f34680f2738a service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:45.265204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-5a7956d2-3f3f-47b6-a9c5-df282a68f246 req-cb3e0ee1-0418-4b2b-83ae-f34680f2738a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:45.265719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-5a7956d2-3f3f-47b6-a9c5-df282a68f246 req-cb3e0ee1-0418-4b2b-83ae-f34680f2738a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:45.278605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-5a7956d2-3f3f-47b6-a9c5-df282a68f246 req-cb3e0ee1-0418-4b2b-83ae-f34680f2738a service nova] Creating event network-changed:9f67a5bc-0fc9-4c09-868c-0306d466fe9e for instance 01c904f6-2f26-43c8-891a-327e09b6cfef on hv-cinder-maste Oct 19 22:05:45.284134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-5a7956d2-3f3f-47b6-a9c5-df282a68f246 req-cb3e0ee1-0418-4b2b-83ae-f34680f2738a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043354 Oct 19 22:05:45.285794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 361/648] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:45.447259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:45.448251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:45.458057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:45.458057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:45.458057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:45.458057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:45.458416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:45.458416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:45.595085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:45.595601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:45.596356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:45.603422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:45.603955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:45.604340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:45.605431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:45.605863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:45.606432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:45.606865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:45.615882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:45.617415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-80ef3c65-b0b3-4fad-8213-f8c35688458d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.174223 Oct 19 22:05:45.617995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 288/649] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:45.831314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:45.839538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-715eb902-6e33-4944-98be-a5a3be585fdd tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.248220 Oct 19 22:05:45.840328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 362/650] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:45 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:46.281872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:46.282480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:46.289481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:46.289972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:46.290415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:46.291138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:46.291597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:46.292283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:46.340917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-86d49bf5-6d86-47b3-8754-94545556cdaf req-c56084b7-8336-4434-967a-77d79a68066e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "name": "network-vif-plugged", "status": "completed", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:05:46.351519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-86d49bf5-6d86-47b3-8754-94545556cdaf req-c56084b7-8336-4434-967a-77d79a68066e service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:46.352217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-86d49bf5-6d86-47b3-8754-94545556cdaf req-c56084b7-8336-4434-967a-77d79a68066e service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:46.352656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-86d49bf5-6d86-47b3-8754-94545556cdaf req-c56084b7-8336-4434-967a-77d79a68066e service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:46.365113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-86d49bf5-6d86-47b3-8754-94545556cdaf req-c56084b7-8336-4434-967a-77d79a68066e service nova] Creating event network-vif-plugged:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:05:46.370669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-86d49bf5-6d86-47b3-8754-94545556cdaf req-c56084b7-8336-4434-967a-77d79a68066e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Oct 19 22:05:46.371305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 363/651] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:05:46.425011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:46.435488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-081a04aa-5e2d-4a77-b030-b839da68969b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.157156 Oct 19 22:05:46.436083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 289/652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:46.644579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:46.645275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:46.651840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:46.652322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:46.652753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:46.653435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:46.653887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:46.654310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:46.786065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:46.795563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:46.796997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:46.798157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9980a75f-d97f-4e3b-9288-feba9c0da1f7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.158236 Oct 19 22:05:46.798731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 364/653] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:46.860910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:46.861556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:46.868167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:46.868642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:46.869080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:46.869771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:46.870229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:46.870653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:46.995638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:47.003252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-57b3aab3-9cb0-49af-9cda-ead8fe83411b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.146109 Oct 19 22:05:47.003813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 290/654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:46 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:47.457648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:47.458267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:47.464394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:47.464878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:47.465315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:47.466035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:47.466493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:47.466921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:47.591109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:47.599348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5d3b064e-1928-4ca8-a0eb-81e28d207379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.145534 Oct 19 22:05:47.599910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 365/655] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:47.823576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:47.824181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:47.830195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:47.830612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:47.831078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:47.831762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:47.832215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:47.832632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:47.961297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:47.969924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:47.971399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:47.972549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7548a5ab-514c-4cad-afe8-1e7f49801b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.152827 Oct 19 22:05:47.973104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 291/656] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:48.025810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:48.026450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:48.032771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:48.033258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:48.033693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:48.034382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:48.034846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:48.035297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:48.368655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:48.376373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e102827-8ed6-4edc-b5a9-1740240a70f9 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.354298 Oct 19 22:05:48.376888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 366/657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:48 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:48.621451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:48.622000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:48.627930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:48.628406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:48.628834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:48.629512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:48.629959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:48.630425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:48.756922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:48.765493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3b07fa2a-b236-4447-abd4-99b265b2a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.147873 Oct 19 22:05:48.766061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 292/658] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:48.998507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:48.999163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:49.005199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:49.005683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:49.006120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:49.006813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:49.007956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:49.008382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:49.138641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:49.147172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:49.148606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:49.149759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dc21e8f7-7e57-4d61-9e43-2fe6b1d0b41b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.155188 Oct 19 22:05:49.150309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 367/659] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:49.399159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:49.399721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:49.406239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:49.406750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:49.407218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:49.407935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:49.408380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:49.408801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:49.535991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:49.544053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f0e0a545-21b6-4d67-a9dd-56476f27f973 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.148849 Oct 19 22:05:49.544620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 293/660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:49 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:49.788389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:49.789588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:49.795523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:49.796010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:49.796449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:49.797141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:49.797593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:49.798015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:49.928823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:49.936952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f7eea35a-4282-454b-9c55-d9fd9cb5bee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.152756 Oct 19 22:05:49.937515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 368/661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:50.174065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:50.174663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:50.180931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:50.181418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:50.181854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:50.182543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:50.183163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:50.183456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:50.312341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:50.321660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:50.323137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:50.324298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d74e2ec-61fa-4c86-b4f0-2c94bf723b1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.154240 Oct 19 22:05:50.324860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 294/662] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:50.567385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:50.568024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:50.574319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:50.574801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:50.575272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:50.575961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:50.576411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:50.576833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:50.701520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:50.708957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-70f087c9-ba02-4d13-ad7c-a79e5799234a tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.145439 Oct 19 22:05:50.709508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 369/663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:50 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:50.959649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:50.960949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:50.967361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:50.967848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:50.968281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:50.968966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:50.969439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:50.969842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:51.095362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:51.103483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-353d2fb6-2abc-4720-90ae-d02ec3ddb279 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.147620 Oct 19 22:05:51.104026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 295/664] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:51.350173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:51.350793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:51.356779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:51.357400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:51.357834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:51.358508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:51.358974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:51.359393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:51.487154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:51.496312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:51.497756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:51.498902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dba0dddf-fa82-4296-95c8-11fa10719320 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.153054 Oct 19 22:05:51.499485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 370/665] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:51.731944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:51.732550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:51.738477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:51.738907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:51.739397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:51.740077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:51.740527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:51.740945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:51.869734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:51.877174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4be67a0-1c50-4cfd-9024-6eb4353200b7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.149043 Oct 19 22:05:51.877752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 296/666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:51 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:52.126773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:52.127409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:52.133712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:52.134196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:52.134631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:52.135342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:52.135807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:52.136220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:52.263385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:52.271588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dd671830-d41d-4b83-ba7e-cd1857f7d137 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.148631 Oct 19 22:05:52.272156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 371/667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:52.524472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:52.525020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:52.531407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:52.531882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:52.532313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:52.532991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:52.533438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:52.533861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:52.658175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:52.666573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:52.668031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:52.669176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fb3a5d84-4836-4607-81fb-25b983f432f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.149292 Oct 19 22:05:52.669736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 297/668] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:52.900043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:52.900675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:52.906596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:52.907120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:52.907555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:52.908238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:52.908717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:52.909136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:53.033601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:53.041187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6c90b2b9-9334-4029-9791-1b1e7830c2ce tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.145415 Oct 19 22:05:53.041712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 372/669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:52 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:53.294535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:53.295093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:53.301338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:53.301829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:53.302271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:53.303007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:53.303735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:53.304263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:53.433469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:53.441573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3022ea08-2cf5-4a78-85dd-c74a39b8d018 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150965 Oct 19 22:05:53.442139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 298/670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:53.694636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:53.695267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:53.701830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:53.702308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:53.702750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:53.703461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:53.703911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:53.704333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:53.836046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:53.844577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:53.846028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:53.847285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0fe5bb7e-2851-4db2-8f45-0bb157f88b32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.156424 Oct 19 22:05:53.847820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 373/671] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:54.063371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:54.063923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:54.070788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:54.071304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:54.071739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:54.072419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:54.072870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:54.073289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:54.091667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:54.202870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:54.210383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0178a1e6-467e-4287-b624-d3d4c65649da tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.151046 Oct 19 22:05:54.210938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 299/672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:54 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:05:54.465900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:54.466533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:54.472752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:54.473239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:54.473675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:54.474359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:54.474813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:54.475270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:54.483816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:05:54.604627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:54.612705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a108ff0-de50-4a1d-9b94-0dfeb498916c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150646 Oct 19 22:05:54.613259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 374/673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:54.873218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:54.873827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:54.880519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:54.881011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:54.881449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:54.882178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:54.883184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:54.883728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:55.011174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:55.019675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:55.021141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:55.022281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cea7be7b-153d-4ea8-a0a1-aebb4f643f97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.152965 Oct 19 22:05:55.022831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 300/674] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:55.232712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:55.233314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:55.239608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:55.240086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:55.240518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:55.241199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:55.242289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:55.242710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:55.371827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:55.379414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-afe46d79-179d-43c8-91b7-713c23231013 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.150474 Oct 19 22:05:55.379974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 375/675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:55 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:55.634935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:55.635508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:55.641883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:55.642363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:55.642797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:55.643512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:55.643969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:55.644395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:55.773268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:55.781306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e0132c5-f71c-4a32-906d-0135ebf98995 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150262 Oct 19 22:05:55.781902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 301/676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:56.047089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:56.047694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:56.053833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:56.054312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:56.054742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:56.055456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:56.055905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:56.056331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:56.179309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:56.187727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:56.189162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:56.190320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-24215b71-bcdc-42c8-b30e-ad3fdebb7895 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.147174 Oct 19 22:05:56.190870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 376/677] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:56.401590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:56.402134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:56.408355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:56.408833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:56.409265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:56.409954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:56.410408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:56.410830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:56.535941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:56.544098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7729c180-62dc-49bc-9ad8-08b5b81110cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.146443 Oct 19 22:05:56.544667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 302/678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:56 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:56.804875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:56.805493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:56.811881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:56.812363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:56.812798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:56.813487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:56.813944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:56.814371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:56.937952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:56.946598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0c9db250-3b34-4a93-a43f-e77e7ceed841 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.145887 Oct 19 22:05:56.947194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 377/679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:57.216100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:57.216702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:57.223071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:57.223547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:57.223975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:57.224652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:57.225100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:57.225514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:57.356008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:57.364863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:57.366810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:57.368040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c63e2e1a-e40f-4f9a-803a-876c376f5250 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.155847 Oct 19 22:05:57.368726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 303/680] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:05:57.566045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:57.566590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:57.572653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:57.573127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:57.573555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:57.574233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:57.574678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:57.575122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:57.704560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:57.712258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-84901a5a-005d-4cb3-b7c9-0c9ac84eea95 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.150120 Oct 19 22:05:57.712816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 378/681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:57 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:57.969911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:57.970545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:57.977063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:57.977544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:57.977984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:57.978666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:57.979160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:57.979581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:58.104032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:58.112424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3e95b184-cdf9-4542-bd12-b6d7b7c9d123 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.146306 Oct 19 22:05:58.112990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 304/682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:58.393550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:58.394179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:58.401347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:58.401870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:58.402297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:58.403047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:58.403498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:58.403915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:58.535549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:58.544002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:58.545422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:58.546560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2387e22-5af9-40a6-8cbf-b2368e04f213 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.156962 Oct 19 22:05:58.547153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 379/683] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:58.734235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:58.734858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:58.741862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:58.742348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:58.742783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:58.743504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:58.743964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:58.744388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:58.872175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:58.879730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0fe95be0-cc45-4ee8-81a5-1b11fa21eb98 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.149304 Oct 19 22:05:58.880294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 305/684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:58 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:59.135158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:59.135770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:59.141617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:59.142102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:59.142535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:59.143246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:59.143697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:59.144123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:59.271488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:59.280635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-68a6aa48-033b-4699-a19b-15df6f85e139 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.149401 Oct 19 22:05:59.281204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 380/685] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:05:59.572045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:59.572595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:59.578592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:59.579114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:59.579556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:59.580247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:59.580706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:59.581133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:59.706306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:59.715402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:59.716835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:05:59.718014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18aaea73-6534-4f0a-85a6-6cace6c44c0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.149984 Oct 19 22:05:59.718575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 306/686] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:05:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:05:59.903952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:05:59.904570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:05:59.911169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:59.911654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:59.912097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:05:59.912791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:05:59.913247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:05:59.913674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.041815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:00.049358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f12ba80b-683a-4069-8132-5e23daaaec25 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.149300 Oct 19 22:06:00.049915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 381/687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:05:59 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:00.304916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:00.305515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:00.312054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.312530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.312960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.313673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.314127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.314544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.443290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:00.452268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-97b52d92-9010-498e-b82e-e7c1652a3676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.152090 Oct 19 22:06:00.453053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 307/688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:00.638190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:00.638653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:00.644799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.645287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.645720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.646411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.646865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.647345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.670232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-49156827-4a14-45d9-b751-c8d60a6d19ce tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc/ips" status: 200 len: 149 microversion: 2.1 time: 0.035944 Oct 19 22:06:00.670789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 382/689] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:06:00 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:06:00.683282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d739c2d-2804-4e8b-bd81-9aa938bfcec7"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:00.685713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:00.691824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.692331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.692774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.693463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.693950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.694373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.744304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:00.745041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:00.750802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.751384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.751820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.752505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.752955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.753377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.772550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Invalid volume: volume 9d739c2d-2804-4e8b-bd81-9aa938bfcec7 is already attached to instances: ca4d839a-a9cb-470c-b01b-b634c0057dd2 Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: POST /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc/os-volume_attachments HTTP/1.1 Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 74 Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:06:00.774369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {"volumeAttachment": {"volumeId": "9d739c2d-2804-4e8b-bd81-9aa938bfcec7"}} Oct 19 22:06:00.775844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Invalid volume: volume 9d739c2d-2804-4e8b-bd81-9aa938bfcec7 is already attached to instances: ca4d839a-a9cb-470c-b01b-b634c0057dd2 Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'server_id': '47e0e488-cb92-478d-8aa4-357c3773dedc', 'body': {'volumeAttachment': {'volumeId': '9d739c2d-2804-4e8b-bd81-9aa938bfcec7'}}} Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9d739c2d-2804-4e8b-bd81-9aa938bfcec7 is already attached to instances: ca4d839a-a9cb-470c-b01b-b634c0057dd2 Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:06:00.776731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9d739c2d-2804-4e8b-bd81-9aa938bfcec7 is already attached to instances: ca4d839a-a9cb-470c-b01b-b634c0057dd2 Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:06:00.777974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9d739c2d-2804-4e8b-bd81-9aa938bfcec7 is already attached to instances: ca4d839a-a9cb-470c-b01b-b634c0057dd2 Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 400 to user: Invalid volume: volume 9d739c2d-2804-4e8b-bd81-9aa938bfcec7 is already attached to instances: ca4d839a-a9cb-470c-b01b-b634c0057dd2 {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-819ebb12-bb72-4868-bcf8-db4e05f0a747 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097425 Oct 19 22:06:00.779171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 308/690] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:06:00 2022] POST /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:06:00.784506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:00.785005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:00.792250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.792742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.793180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.793980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:00.794438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:00.794864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:00.819799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:06:00.883855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:00.892661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:00.894022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:00.895216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b2e44d0-a8d5-4933-a227-b63db8e0eebc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.155660 Oct 19 22:06:00.895776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 383/691] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:01.072325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:01.072993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:01.079368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.079851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.080276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:01.080956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.081403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.081944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:01.084268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4ef165a8-2f21-47c0-be86-6d64a73be0e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 204 len: 0 microversion: 2.1 time: 0.303091 Oct 19 22:06:01.084858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 309/692] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:06:00 2022] DELETE /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:06:01.096779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:01.097477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:01.104091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.104637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.105081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:01.105783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.106245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.106685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:01.220036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:01.228096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-63d28ed0-35ca-4cb1-ad2d-3457252170b4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.159556 Oct 19 22:06:01.228669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 384/693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:01 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:01.239844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:01.247439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac15a342-d292-4733-918d-903dd3a935a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.154863 Oct 19 22:06:01.247999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 310/694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:01 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:01.474936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:01.475561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:01.481469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.481976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.482405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:01.483118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.483567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.483982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:01.612059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:01.620832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0c62545f-b56b-4250-8e53-e57a6be4aed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.149855 Oct 19 22:06:01.621399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 385/695] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:01.921602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:01.922215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:01.929032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.929519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.929959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:01.930645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:01.931138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:01.931561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:02.057584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:02.066139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:02.067796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:02.068951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-53cba9f2-20b7-4e61-a2b1-2822cd5c9b03 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.151228 Oct 19 22:06:02.070006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 311/696] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:02.251664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:02.291572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:02.291572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:02.291572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:02.291572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:02.292071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:02.292071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:02.292071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:02.292650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:02.292650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:02.292650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:02.292650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:02.293352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:02.293352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:02.293352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:02.293352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:02.402614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:02.410889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f0bf88ad-595d-44be-b7fb-5c3163eeea96 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.163178 Oct 19 22:06:02.411492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 386/697] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:02 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:02.436191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:02.444100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-84e0b21e-3841-450b-82a9-a3341af6a1de tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.175395 Oct 19 22:06:02.445253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 312/698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:02 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:02.687960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:02.687960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:02.687960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:02.687960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:02.688461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:02.688461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:02.688461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:02.688461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:02.799276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:02.808356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5682db79-98da-43a3-b533-96b4010ddeb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.168534 Oct 19 22:06:02.808920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 387/699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:03.095120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:03.095726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:03.102558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.103069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.103504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.104192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.104653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.105076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.234001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:03.242502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:03.243911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:03.246207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-857a540e-913a-4a98-b012-ba3f58db7f30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.153835 Oct 19 22:06:03.246207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 313/700] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:03.433433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:03.434044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:03.440424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.440906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.441342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.442027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.442482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.442903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.467750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:03.468362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:03.474300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.474777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.475239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.476530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.476977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.477394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.496919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:03.575680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:03.583453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bbde3695-72b5-4218-bcd3-7d41522454d6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.153871 Oct 19 22:06:03.584009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 388/701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:03 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:03.607913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:03.615566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6aec494c-ab12-456f-9042-659dd45b63d1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.151689 Oct 19 22:06:03.616146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 314/702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:03 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:03.831134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:03.831741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:03.838422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.838899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.839353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.840037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:03.840488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:03.840904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:03.965637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:03.973907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-04f1309e-f7e3-4630-aa76-3f5b965af9d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.146799 Oct 19 22:06:03.974474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 389/703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:04.269525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:04.270106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:04.277107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:04.278199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:04.278199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:04.278900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:04.279373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:04.279790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:04.409407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:04.418440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:04.419905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:04.421051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1ed078e0-7b3a-4501-9632-c286a87b4772 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.155445 Oct 19 22:06:04.421603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 315/704] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:04.607466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:04.608005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:04.614365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:04.614846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:04.615344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:04.616027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:04.617086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:04.617508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:04.637435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:04.638036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:04.644060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:04.644540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:04.644969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:04.645650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:04.646110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:04.646528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:04.747872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:04.755569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f3577685-6ccc-43a9-a53b-cb9749eefc4d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.151971 Oct 19 22:06:04.756135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 390/705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:04 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:04.776395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:04.784017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-55db414a-ae04-47f7-9f5a-5320a2c43e54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.150373 Oct 19 22:06:04.784592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 316/706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:04 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:04.996778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:04.997388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:05.003231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.003711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.004139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.004818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.005269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.005687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.010137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:05.136128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:05.144244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-62025bb2-cdcc-4261-bbe7-a8c09f7950f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.151330 Oct 19 22:06:05.144806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 391/707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:05.447444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:05.448049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:05.454422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.454907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.455375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.456086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.456542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.456964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.585692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:05.594126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:05.595593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:05.596740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fe83b696-4d8e-4c7c-9187-d2dbe60b1615 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.153873 Oct 19 22:06:05.597301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 317/708] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:05.777311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:05.777918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:05.784303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.784789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.785223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.785924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.786378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.786803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.808652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:05.809412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:05.815226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.815778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.816307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.817074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:05.817626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:05.818112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:05.914547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:05.922340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78eddbbb-3851-4e0c-87b0-53a1b0a5eaeb tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.148724 Oct 19 22:06:05.923078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 392/709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:05 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:05.945217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:05.952722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5e1d2240-d641-400f-9ce5-25d4138cd7c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.148683 Oct 19 22:06:05.953277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 318/710] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:05 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:06.169527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:06.170134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:06.176052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.176537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.176968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:06.177657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.178109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.178787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:06.308533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:06.316701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ceecac5f-5631-49d0-81dc-e90d32932b67 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.151000 Oct 19 22:06:06.317268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 393/711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:06.621692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:06.622294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:06.628671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.629149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.629582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:06.630261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.630708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.631159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:06.760302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:06.769165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:06.770730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:06.771996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a2cb2873-f3aa-478b-bab6-0d819a9073ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.154228 Oct 19 22:06:06.773178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 319/712] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:06.946042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:06.946653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:06.953042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.953521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.953952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:06.954635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.955114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.955537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:06.974920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:06.975554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:06.981429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.981919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.982359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:06.983078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:06.983538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:06.983969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:07.083561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:07.091355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9c18935d-cdb2-4239-b189-e5c42afa3c72 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.149674 Oct 19 22:06:07.091971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 394/713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:06 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:07.113934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:07.122441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ca2c78d7-6d30-4253-9ab4-7b9c79c1cea5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.151350 Oct 19 22:06:07.123041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 320/714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:06 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:07.339608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:07.340134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:07.345976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:07.346458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:07.346886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:07.347585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:07.348030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:07.348446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:07.474343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:07.482833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0dbfa86c-7ccc-40f0-9f89-6c098d77219e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.147118 Oct 19 22:06:07.483414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 395/715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:07.797842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:07.798441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:07.805027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:07.805513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:07.805943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:07.806618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:07.807097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:07.807514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:07.934073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:07.942567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:07.944029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:07.945197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-904a573a-9368-457d-8d63-605fd0743a26 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.151312 Oct 19 22:06:07.945749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 321/716] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:08.113619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:08.114238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:08.120783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.121300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.121742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:08.122434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.122892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.123346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:08.150689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:08.150689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:08.156562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.157053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.157486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:08.158182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.158632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.159082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:08.255971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:08.263716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e60bd365-3ccf-4796-9ea4-664aa901cfa7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.153865 Oct 19 22:06:08.264341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 396/717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:08 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:08.292173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:08.300138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0880f186-a484-48de-9213-2eb9a013d49f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.154930 Oct 19 22:06:08.300711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 322/718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:08 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:08.505509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:08.506031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:08.512683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.513163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.513592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:08.514583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.515426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.516188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:08.644225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:08.652596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b8f6b709-f91d-4357-8151-c39729d496c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150944 Oct 19 22:06:08.653168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 397/719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:08.969468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:08.970070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:08.977140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.977614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.978045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:08.978725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:08.979204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:08.979622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:09.104477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:09.112895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:09.114317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:09.115496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b2769403-2315-48a8-ad60-8da0edae59e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.149884 Oct 19 22:06:09.116660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 323/720] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:09.286911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:09.287694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:09.294562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:09.295073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:09.295502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:09.296178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:09.296625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:09.297042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:09.323531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:09.324066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:09.329965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:09.330453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:09.330901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:09.331626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:09.332086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:09.332536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:09.428678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:09.436556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-174c1b44-bb93-4e66-b670-b6c5928628cf tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.153554 Oct 19 22:06:09.437135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 398/721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:09 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:09.463243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:09.470888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9838842d-076d-45a9-a140-67e75ec98391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.151319 Oct 19 22:06:09.471485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 324/722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:09 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:09.675431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:09.676010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:09.682140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:09.682628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:09.683115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:09.683810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:09.684267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:09.684696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:09.809710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:09.817807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dccb12b4-1235-487a-9274-8d5c8fa8caca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.146302 Oct 19 22:06:09.818369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 399/723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:10.141046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:10.141690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:10.144147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:10.148904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.149389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.149831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.150524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.151005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.153993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.279252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:10.287800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:10.289743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:10.290899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a51b0e59-982d-46d5-853f-da02ed62f57b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.153763 Oct 19 22:06:10.291484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 325/724] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:10.459657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:10.460263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:10.467276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.467751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.468181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.468858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.469304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.469721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.492997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:10.493536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:10.499520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.500003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.500435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.501116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.501566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.501985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.600872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:10.608489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-60bb52d5-b60a-4d25-86d4-261aca218982 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.152699 Oct 19 22:06:10.609046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 400/725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:10 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:10.629512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:10.637561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-500f92c5-4fbd-4672-a2d6-af98d61becee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.148418 Oct 19 22:06:10.638158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 326/726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:10 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:10.841603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:10.842208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:10.848357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.848832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.849258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.849935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:10.850383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:10.850800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:10.977594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:10.985609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-34f4a6c8-e32c-4c32-bda3-4f967a7eebcf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.147815 Oct 19 22:06:10.986163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 401/727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:11.317516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:11.318057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:11.325754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:11.327628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:11.327628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:11.327628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:11.327862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:11.328255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:11.460350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:11.469978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:11.471444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:11.472606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e8ec1a5-eea5-4a60-9ae9-93f116f08783 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.159138 Oct 19 22:06:11.473159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 327/728] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:11.631388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:11.631925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:11.639118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:11.639607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:11.640046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:11.640750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:11.641204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:11.641651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:11.661375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:11.662008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:11.667929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:11.668415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:11.668846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:11.669528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:11.669979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:11.670401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:11.768381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:11.775989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-25fa6a2c-13d2-4853-9527-a59980811281 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.148459 Oct 19 22:06:11.776558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 402/729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:11 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:11.798248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:11.806816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7e9acbfc-b82b-42bf-9ac2-7fbe7779aa51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.149240 Oct 19 22:06:11.807399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 328/730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:11 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:12.008714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:12.009318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:12.015384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.015868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.016298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.016974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.017418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.017833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.147257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:12.155919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-be218aa8-e4c2-4873-a4cd-03e8407353e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150996 Oct 19 22:06:12.156774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 403/731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:12.497524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:12.498124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:12.504652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.505128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.505556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.506233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.506682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.507133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.639672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:12.651308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:12.653893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:12.655105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d2fbccde-7919-43f4-9766-8f557021cd3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.161435 Oct 19 22:06:12.655678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 329/732] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:12.801326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:12.801937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:12.808590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.809091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.809566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.810319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.810776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.811223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.829559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:12.830156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:12.838444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.839356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.840086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.841112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:12.841563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:12.841983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:12.953427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:12.961026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a862d1b-7eb6-4027-8260-bbd3624eb015 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.165032 Oct 19 22:06:12.961608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 404/733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:12 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:12.979512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:12.987295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-985068db-295f-424d-93ae-f9780a7c749b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.161539 Oct 19 22:06:12.987865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 330/734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:12 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:13.035795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfe992a2-4461-4e3b-a459-f37b3b12f942"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:13.038220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:13.044315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.044730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.045161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:13.045858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.046926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.047389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:13.185405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:13.186090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:13.192162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.192713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.193210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:13.193994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.194713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.195779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:13.200212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:13.347237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:13.356955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bd1af16e-f90f-48e7-b9df-d893803b25f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.180637 Oct 19 22:06:13.357708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 331/735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:13.689491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:13.690093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:13.696334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.696812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.697241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:13.697923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.698406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.698794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:13.826753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:13.835411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:13.837435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:13.838621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c1a82fa-44fb-4f07-aab3-663eca381db1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.153073 Oct 19 22:06:13.839200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 332/736] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:13.983564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:13.984229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:13.990100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.990588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.991059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:13.991753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:13.992211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:13.992639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:14.118271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:14.125883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f392d9f4-8aed-45f0-b67b-c77b46eeb931 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.146105 Oct 19 22:06:14.126435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 333/737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:13 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:14.130743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:14.131369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:14.137342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:14.137827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:14.138268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:14.138981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:14.139435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:14.139856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:14.271257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:14.279816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a7b3652f-0702-49f5-b47b-55437f57661a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.152451 Oct 19 22:06:14.280369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 334/738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:14 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:14.380241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:14.380885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:14.387430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:14.387913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:14.388373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:14.389046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:14.389503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:14.389931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:14.520628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:14.528783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3b2191c1-5f2a-4dd5-9903-ea4a462f5a5a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.152609 Oct 19 22:06:14.529344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 335/739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:14.864200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:14.864841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:14.871927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:14.872410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:14.872847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:14.873533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:14.873989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:14.874407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:15.004128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:15.013221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:15.014663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:15.015854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8edee5d4-513f-48fb-9e9e-1c6561861417 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.155560 Oct 19 22:06:15.016448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 336/740] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:15.148975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:15.149516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:15.155298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:15.155786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:15.156227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:15.156915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:15.157372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:15.157796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:15.288785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:15.296968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b5a4b18b-4fe1-4d24-95c1-c0d960b9ba91 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.152172 Oct 19 22:06:15.311193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 337/741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:15 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:15.311193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:15.311193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:15.311193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:15.311772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:15.311772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:15.311772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:15.312238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:15.312657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:15.458867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:15.467685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f80ac38-de16-43e6-8fa8-054e8e872c20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.168159 Oct 19 22:06:15.468148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 338/742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:15 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:15.554873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:15.555627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:15.561401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:15.561881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:15.562311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:15.563021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:15.563474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:15.563894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:15.691330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:15.700144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fe765158-e9f8-48e3-b970-c42e6367ca9d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.149287 Oct 19 22:06:15.700708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 339/743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:16.040914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:16.041524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:16.047891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.048377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.048807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.049479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.049925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.050340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.176357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:16.185633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:16.187095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:16.188248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2aa5e607-bf08-4d04-a20b-5543b1e5dd3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.151204 Oct 19 22:06:16.188806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 340/744] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:16.321242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:16.321793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:16.327917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.328402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.328845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.329525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.329975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.330400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.464585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:16.472169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e70feaec-7e47-4b0c-98e1-794a95c5ca99 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.154848 Oct 19 22:06:16.472729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 341/745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:16 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:16.489511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:16.490108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:16.496227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.496703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.497131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.497810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.498259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.498679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.629316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:16.633875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-844a9526-a256-4aa4-b9d8-aadfe75151b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.147810 Oct 19 22:06:16.634439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 342/746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:16 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:16.723628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:16.724237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:16.730727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.731250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.731687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.732419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:16.732872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:16.733293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:16.862161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:16.870303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a6023b2d-c391-4207-82d3-dd2794bffa85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150393 Oct 19 22:06:16.870870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 343/747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:17.215961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:17.216577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:17.222996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.223484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.223918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:17.224602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.225055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.225477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:17.354351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:17.362771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:17.364237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:17.365376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e5d0d0a2-28ea-4b3a-aa52-7b6074a3bed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.154798 Oct 19 22:06:17.365934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 344/748] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:17.495489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:17.496093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:17.501991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.502471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.502898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:17.503602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.504048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.504462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:17.628867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:17.636979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6e87d925-454b-4b9a-800d-8f73def7cab2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.145828 Oct 19 22:06:17.637536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 345/749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:17 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:17.656298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:17.656893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:17.662349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.662824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.663286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:17.663990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.664436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.664857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:17.793928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:17.801622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-22f8180d-4b82-43c7-9e21-825b358e34b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.148762 Oct 19 22:06:17.802189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 346/750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:17 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:17.892696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:17.893303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:17.899095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.899579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.900016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:17.900719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:17.901173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:17.901597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:18.024057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:18.027435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:18.032343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ee0476cb-4073-4b34-a75a-024379a6a8c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.143261 Oct 19 22:06:18.032912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 347/751] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:18.391276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:18.391936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:18.399321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:18.399809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:18.400405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:18.400924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:18.401377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:18.401797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:18.535964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:18.544477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:18.545897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:18.547061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b76cf92-4198-4615-a00c-33d1bb266877 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.159728 Oct 19 22:06:18.547618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 348/752] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:18.659314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:18.659859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:18.666254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:18.666748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:18.667210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:18.667906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:18.668367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:18.668792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:18.793325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:18.801133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-36e78825-8568-46b1-bd69-e6a3d84f7dd6 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.145800 Oct 19 22:06:18.801714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 349/753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:18 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:18.824407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:18.825012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:18.830757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:18.831283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:18.831718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:18.832395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:18.832841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:18.833331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:18.958865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:18.967074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d15dc73a-6810-4dbe-807f-cfa4f378dd96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.146352 Oct 19 22:06:18.967716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 350/754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:18 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:19.061071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:19.061678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:19.067953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.068431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:19.068986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:19.069667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.070121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:19.070534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:19.200869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:19.208953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0cbd2ab0-69d3-406c-9e95-d888403d774f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.151781 Oct 19 22:06:19.209511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 351/755] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:19.572650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:19.573292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:19.579729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.580217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:19.580659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:19.581349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.581807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:19.582235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:19.708219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:19.716909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:19.718335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:19.719561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6cff3ce9-6544-4a06-9803-0ac71b98df98 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.151236 Oct 19 22:06:19.720142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 352/756] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:19.824538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:19.825136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:19.830895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.831399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:19.831826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:19.832497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.832949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:19.833364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:19.962689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:19.970254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a7f1552d-7cf6-4f05-89ea-6c8b0824344c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.149970 Oct 19 22:06:19.970809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 353/757] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:19 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:19.990464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:19.991097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:19.997825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.998339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:19.998774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:19.999503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:19.999958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:20.000380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:20.126531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:20.134202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1e3e5dab-d083-4125-8fa1-589295a8ac00 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.147439 Oct 19 22:06:20.134765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 354/758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:19 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:20.232544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:20.233085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:20.238883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:20.239400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:20.239836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:20.240525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:20.240978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:20.241402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:20.370508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:20.378711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-85c3956a-b4bc-40dc-a259-b86db7697e9f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.149840 Oct 19 22:06:20.379324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 355/759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:20.744601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:20.745210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:20.751543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:20.752026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:20.752489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:20.753182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:20.753645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:20.754064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:20.878543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:20.887688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:20.889153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:20.890298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6321ae54-09e8-4e01-829f-93e673f11263 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.149698 Oct 19 22:06:20.890862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 356/760] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:20.992824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:20.993421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:20.999268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:20.999723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.000154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:21.000831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:21.001279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.001696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:21.125965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:21.133604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9b2e2efa-1d28-488b-9e1b-cddd0a11fc8d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.144973 Oct 19 22:06:21.134161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 357/761] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:20 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:21.156572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:21.157167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:21.162880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:21.163408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.164383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:21.165058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:21.165505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.165924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:21.293963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:21.301616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a04b88a9-1d99-444b-b494-273aa012824a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.148638 Oct 19 22:06:21.302187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 358/762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:21 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:21.401969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:21.402575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:21.408423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:21.408906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.409342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:21.410026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:21.410478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.410900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:21.538842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:21.547117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17b811ff-fb6f-4600-a0d5-d8da5086ff93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.149271 Oct 19 22:06:21.547630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 359/763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:21.916166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:21.916763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:21.923122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:21.923601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.924038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:21.924722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:21.925176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:21.925595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:22.055663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:22.064146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:22.065578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:22.066728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b8af9a8b-4c73-4aa3-b165-273ff3e385c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.154534 Oct 19 22:06:22.067446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 360/764] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:22.156074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:22.156675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:22.162361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:22.162842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:22.163309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:22.163992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:22.164446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:22.164868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:22.289611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:22.297255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b71e679f-25e3-4591-979f-cd8767f7ef7e tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.144739 Oct 19 22:06:22.297813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 361/765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:22 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:22.325063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:22.325672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:22.331380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:22.331860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:22.332294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:22.332979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:22.333429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:22.333848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:22.457132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:22.464639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cf51b293-0ab7-46ea-a8f7-9f039d0df508 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.143342 Oct 19 22:06:22.465207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 362/766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:22 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:22.569306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:22.569913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:22.579620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:22.580108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:22.580546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:22.581241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:22.581697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:22.582123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:22.711193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:22.719372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a25c0fd7-302d-4728-aab3-5fd820eba12e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.153802 Oct 19 22:06:22.719942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 363/767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:23.042571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=91 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:23.092957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:23.093586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:23.099932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.100411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.100840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.101517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.101963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.102381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.117809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=88 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:23.119960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:23.234865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:23.243391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:23.244803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:23.245940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c0501a44-5042-4e69-b24d-81e448529b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.156822 Oct 19 22:06:23.246497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 364/768] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:23.320336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:23.320874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:23.327279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.329652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.329652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.329652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.329652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.329999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.457724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:23.465278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a9ed9adb-7380-4ff6-8ef0-2797e58dc714 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.148590 Oct 19 22:06:23.465842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 365/769] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:23 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:23.487610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:23.488220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:23.494417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.494901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.495375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.496064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.496521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.496946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.622079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:23.629673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4dba2301-0946-4aa4-b3a1-f52139be4f1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.145614 Oct 19 22:06:23.630232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 366/770] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:23 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:23.742584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:23.743069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:23.749017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.749494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.751426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.751426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:23.751426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:23.751727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:23.882852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:23.891311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-45af1515-d98e-42e6-be02-e182f65ff215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.152537 Oct 19 22:06:23.891868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 367/771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:24.271242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:24.271878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:24.278945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.285083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.285083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:24.285083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.285083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.285496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:24.408359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:24.417382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:24.418803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:24.419972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c480251-fafc-492f-839a-7216d3847e57 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.152682 Oct 19 22:06:24.420535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 368/772] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:24.487474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:24.488075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:24.493672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.494144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.494572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:24.495272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.495721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.496136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:24.621030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:24.628493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9218f65-aab0-4214-9c29-a08412a53c84 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.144481 Oct 19 22:06:24.629050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 369/773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:24 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:24.653117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:24.653720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:24.659335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.659820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.660254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:24.660941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.661394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.661814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:24.790443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:24.798237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-264191f3-3883-4ae1-a27f-0d9e27745ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.149222 Oct 19 22:06:24.798796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 370/774] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:24 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:24.913579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:24.914181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:24.920113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.920590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.921025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:24.921701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:24.922151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:24.922572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:25.046840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:25.055784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e973b2da-831f-49ef-874f-670801949d59 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.145479 Oct 19 22:06:25.056354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 371/775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:25.445124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:25.445870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:25.452209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:25.452695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:25.453141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:25.453823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:25.454281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:25.454708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:25.581700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:25.590710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:25.592182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:25.593345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-385aeeca-6452-49c6-a87d-29d6e0cac4fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.152122 Oct 19 22:06:25.593903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 372/776] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:25.651518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:25.652121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:25.657911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:25.658387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:25.658817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:25.659549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:25.659983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:25.660403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:25.784767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:25.793130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c3d214b5-1c5f-4b65-9596-0175506827c4 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.145920 Oct 19 22:06:25.793698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 373/777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:25 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:25.822059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:25.822658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:25.828306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:25.828781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:25.829209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:25.829889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:25.830338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:25.830763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:25.956876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:25.965027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-21f5bf2a-4acf-45ea-adb0-b7d284076e94 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.146547 Oct 19 22:06:25.965587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 374/778] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:25 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:26.078941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:26.079562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:26.081339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:26.085900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:26.086385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:26.087438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:26.088133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:26.088595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:26.089018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:26.217459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:26.225609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-34128b07-3a34-4b67-b13e-d1cc3741af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150386 Oct 19 22:06:26.226174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 375/779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:26.619547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:26.620195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:26.626598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:26.627120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:26.627562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:26.628255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:26.628713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:26.629174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:26.763094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:26.765206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:26.766623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:26.767787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a2703976-d150-4844-9c75-2b505e32947e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.152693 Oct 19 22:06:26.768342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 376/780] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:26.815269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:26.815872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:26.821793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:26.822271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:26.822701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:26.823405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:26.823856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:26.824274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:27.168019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:27.175421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-44382770-6e70-49b2-9213-43022563c5a7 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.363813 Oct 19 22:06:27.175985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 377/781] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:26 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:27.181155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:27.181743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:27.186994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:27.187524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:27.187956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:27.188630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:27.189075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:27.189488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:27.314138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:27.322377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1aeed232-bd8f-401d-a926-d23bd5a91022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.145467 Oct 19 22:06:27.322940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 378/782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:27 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:27.327394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:27.327994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:27.333417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:27.333906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:27.334347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:27.335057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:27.335580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:27.336030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:27.462233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:27.470806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4a82f8da-2b19-4913-bbb7-2896e65cb83f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.146430 Oct 19 22:06:27.470915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 379/783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:27.793428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:27.795277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:27.800654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:27.801211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:27.801574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:27.802266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:27.802722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:27.803178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:27.927735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:27.937035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:27.938483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:27.939671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-058ff2e5-11d9-4cb2-8092-7f053d76ef76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.150697 Oct 19 22:06:27.940265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 380/784] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:28.197508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:28.198121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:28.204018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.204501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.204939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:28.205627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.206082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.206513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:28.210464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:28.332809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:28.340386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c14a2b7e-7a99-4f76-8a99-81c709652a24 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.146741 Oct 19 22:06:28.340954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 381/785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:28 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:28.345269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:28.345868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:28.351367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.351852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.352290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:28.352979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.353432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.353859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:28.484591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:28.492208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2ac21f0e-b0c7-409f-b01c-64a99a207ead tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.150333 Oct 19 22:06:28.492813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 382/786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:28 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:28.497133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:28.499102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:28.503249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.503728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.504237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:28.504915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.505365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.505783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:28.635334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:28.643692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-288d8e59-7e7c-49c7-8010-c2e2023f5e18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.149908 Oct 19 22:06:28.644277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 383/787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:28.964527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:28.965151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:28.971547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.972025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.972455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:28.973135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:28.973584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:28.974001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:29.105998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:29.114578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:29.116095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:29.117244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6b6e1d67-cd8c-42b8-aeba-f3ba79661817 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.156657 Oct 19 22:06:29.117795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 384/788] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:29.363158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:29.363711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:29.370157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:29.370633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:29.371106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:29.371786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:29.372234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:29.372656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:29.497365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:29.505212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0beb1092-993f-449f-80ad-9e6b32e9488d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.145954 Oct 19 22:06:29.505782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 385/789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:29 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:29.515116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:29.515721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:29.521225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:29.521706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:29.522149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:29.522831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:29.523320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:29.523748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:29.652898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:29.660556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1c249a5c-1953-4fcd-bc8d-ffffa8f43e2d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.149055 Oct 19 22:06:29.661153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 386/790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:29 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:29.667271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:29.667913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:29.673544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:29.674027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:29.674463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:29.675184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:29.675638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:29.676062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:29.802869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:29.811402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c5450ee-ffeb-4e11-bfee-887270a2fb47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.148189 Oct 19 22:06:29.811966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 387/791] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:30.143162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:30.143926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:30.151174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.151664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.152394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.153097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.153551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.153977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.279419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:30.288052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:30.289544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:30.290708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e9fc13a2-a0e1-4147-bb37-6e1c95a6e9f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.151498 Oct 19 22:06:30.291311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 388/792] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:30.527680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:30.528214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:30.534029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.534494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.534922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.535616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.536065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.536476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.664415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:30.672522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-45720525-8bea-4701-9ae3-1eee037aeac2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.148790 Oct 19 22:06:30.673092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 389/793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:30 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:30.684463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:30.685065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:30.690654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.691172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.691641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.692327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.692780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.693203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.822493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:30.830398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-97fda297-b884-425b-810d-9887529fc2ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.150082 Oct 19 22:06:30.830985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 390/794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:30 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:30.835273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:30.835902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:30.841363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.841841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.842275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.842982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:30.843434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:30.843855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:30.973524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:30.982320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6d53bd4c-8394-49ea-a81d-6099854c8217 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.150403 Oct 19 22:06:30.982893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 391/795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:31.315698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:31.316332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:31.322709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:31.323228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:31.323660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:31.324345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:31.324798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:31.325219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:31.449860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:31.458422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:31.459889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:31.461047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c66c1e7-95e8-428f-84fa-dfdf04d4df17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.149275 Oct 19 22:06:31.461614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 392/796] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:31.695379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:31.696109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:31.702539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:31.703002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:31.703445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:31.704130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:31.704583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:31.705003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:31.831007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:31.839169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4b6b208-b2ff-4efe-a58e-e1203dc20a26 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.147471 Oct 19 22:06:31.839731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 393/797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:31 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:31.852026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:31.852671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:31.858316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:31.858795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:31.859257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:31.859936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:31.860383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:31.860801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:31.987432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:31.995466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-881eac35-15bf-4085-ac24-fff6155946a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.146927 Oct 19 22:06:31.996029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 394/798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:31 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:32.005062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:32.005685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:32.011900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:32.012385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:32.012854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:32.013541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:32.014001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:32.014424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:32.138648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:32.146736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1751e258-a84c-4b16-95ab-ade85bf75aa0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.145212 Oct 19 22:06:32.147347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 395/799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:32.487379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:32.488023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:32.495062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:32.495496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:32.495930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:32.496620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:32.497074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:32.497497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:32.631260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:32.639804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:32.641256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:32.642413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-733abae3-3080-4a4b-8fb6-910bc30eb6d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.158988 Oct 19 22:06:32.642994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 396/800] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:32.861298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:32.861911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:32.867817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:32.868309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:32.868750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:32.870069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:32.870532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:32.870982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:32.995517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:32.998929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:33.003394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-25bbee83-9a09-4458-a7dc-91b6fc295020 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.145835 Oct 19 22:06:33.003963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 397/801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:32 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:33.018673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:33.019305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:33.025763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:33.026250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:33.026687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:33.027407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:33.027867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:33.028295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:33.156332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:33.163949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c930c7d2-ab27-41bf-9c53-ebe86b373af0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.148797 Oct 19 22:06:33.164525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 398/802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:33 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:33.169489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:33.170088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:33.175600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:33.176086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:33.176524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:33.177213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:33.177676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:33.178099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:33.311978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:33.320135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e5e2d401-888d-4631-805d-895eb9d30391 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1723 microversion: 2.1 time: 0.154682 Oct 19 22:06:33.320982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 399/803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:33.668009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:33.668745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:33.675155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:33.675649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:33.676087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:33.677077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:33.677293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:33.677784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:33.819408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:33.828576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:33.830002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:33.831182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1fb7d79d-9871-4c67-af5b-1edabc89b240 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.167230 Oct 19 22:06:33.831732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 400/804] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:34.037808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:34.038338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:34.044289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.044771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.045207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.045917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.046370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.046793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.177165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:34.185790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f8b5a021-1f67-492d-bc78-9f4c5d3887ac tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.152059 Oct 19 22:06:34.186351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 401/805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:34 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:34.190821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:34.191463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:34.196939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.197424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.197863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.198562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.199041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.199470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.325197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:34.332862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-87f8da1d-84c1-4219-a93a-d80a64f8f7f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.145521 Oct 19 22:06:34.333439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 402/806] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:34 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:34.345908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:34.346554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:34.352556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.353049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.354016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.354702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.355198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.355627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.483892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:34.492177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4717670f-bfed-4b03-9d51-7b766abddd8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1700 microversion: 2.1 time: 0.149976 Oct 19 22:06:34.492741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 403/807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1700 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:34.514423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac4b0ec1-dcaf-4108-957f-b856be83764e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:34.520032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac4b0ec1-dcaf-4108-957f-b856be83764e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.520519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac4b0ec1-dcaf-4108-957f-b856be83764e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.520955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac4b0ec1-dcaf-4108-957f-b856be83764e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.542818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac4b0ec1-dcaf-4108-957f-b856be83764e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Going to try to start instance {{(pid=121021) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 22:06:34.703685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac4b0ec1-dcaf-4108-957f-b856be83764e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/action" status: 202 len: 0 microversion: 2.1 time: 0.192501 Oct 19 22:06:34.704322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 404/808] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:06:34 2022] POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 22:06:34.713368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:34.714064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:34.720076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.720565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.721045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.721701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.722160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.722588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.850294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:34.858976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-78467046-3229-42b6-bee7-ed7b95312bc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1709 microversion: 2.1 time: 0.150205 Oct 19 22:06:34.859905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 405/809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:34.864251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:34.864853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:34.870209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.870686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.871161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:34.871844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:34.872294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:34.872714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:35.149312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:35.157736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:35.159206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:35.160356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4534764e-411a-4002-b5b2-97e86c4bfa67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.299545 Oct 19 22:06:35.160906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 406/810] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:35.208039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:35.208646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:35.214364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:35.214845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:35.215313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:35.216001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:35.216455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:35.216877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:35.349986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:35.358199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1f53617d-3fb8-40f1-ad9c-89cfd51c097d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.153756 Oct 19 22:06:35.358756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 407/811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:35 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:35.367164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:35.367164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:35.369239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:35.369732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:35.370168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:35.370856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:35.371365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:35.371797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:35.497860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:35.505639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-faaabb16-c7a3-4fd6-9cf4-2a817c83debf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.145916 Oct 19 22:06:35.506198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 408/812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:35 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:35.882379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:35.891099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:35.891099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:35.891099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:35.891099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:35.891514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:35.891661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:35.892084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:36.024373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:36.032739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5a27e218-c27a-4b82-b084-1d0cb06f790f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1709 microversion: 2.1 time: 0.154318 Oct 19 22:06:36.033295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 409/813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:36.185811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:36.186340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:36.192408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:36.192890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:36.193323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:36.194008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:36.194460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:36.194880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:36.320457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:36.328950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:36.332514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:36.332514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b7446a8-1bcd-4517-b344-323f69cb2a81 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.149618 Oct 19 22:06:36.332514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 410/814] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:36.380597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:36.381203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:36.387047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:36.387532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:36.387965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:36.388647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:36.389097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:36.389518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:36.519733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:36.528029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-57b207fb-7e98-499f-97d0-227285f82314 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.151157 Oct 19 22:06:36.528587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 411/815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:36 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:36.533086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:36.533685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:36.539073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:36.539551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:36.539985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:36.540666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:36.541121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:36.541540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:36.667446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:36.674976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-66dac5a1-5c4d-4f9c-a711-0c6ae8154aee tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.145399 Oct 19 22:06:36.675530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 412/816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:36 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:37.057222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:37.057804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:37.063720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.064215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.064647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.065336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.065813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.066233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.086277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:37.202907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:37.211031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-193b3d44-29be-46de-85fe-b0e097ea3581 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1709 microversion: 2.1 time: 0.158569 Oct 19 22:06:37.211593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 413/817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:37.358186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:37.358790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:37.365927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.366406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.366883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.367597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.368054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.368471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.500838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:37.509694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:37.511158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:37.512320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6f0c19a4-619d-4439-bca4-60cf8d755df4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.158025 Oct 19 22:06:37.512880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 414/818] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:37.550221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:37.550840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:37.574979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.574979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.574979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.574979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.575488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.575488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.580690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-79dae54d-2721-46a0-8cef-01d1b7b93413 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "POST /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 24.548631 Oct 19 22:06:37.586480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 405/819] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:06:13 2022] POST /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057/os-volume_attachments => generated 194 bytes in 24550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:06:37.698834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:37.700022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:37.708976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.710228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.710228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.717255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:37.717874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:37.718466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:37.830740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:37.844883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3236a296-7eba-46bd-be70-1f29084df6a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.298226 Oct 19 22:06:37.846220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 415/820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:37 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:38.053346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:38.061462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d0b0573b-0e87-466d-b436-b5ec13ea828b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1677 microversion: 2.1 time: 0.367509 Oct 19 22:06:38.062083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 406/821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:37 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1677 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:38.243173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:38.243798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:38.250567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.251399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.252063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:38.252769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.253430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.253865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:38.441698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:38.450719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-91126317-96d3-4675-b42d-31b81ea7d618 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1709 microversion: 2.1 time: 0.211954 Oct 19 22:06:38.451553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 416/822] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:38.537262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:38.538007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:38.545335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.545981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.546287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:38.547407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.547899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.548360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:38.811786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:38.836384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:38.838990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:38.842765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c43616c9-c112-4b4c-9513-194b1d23d49b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.309662 Oct 19 22:06:38.843723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 407/823] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:38.868831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:38.869511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:38.878926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.892062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.892556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:38.893350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.893830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.894448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:38.908648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:38.910269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:38.923756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.924162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.924598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:38.927772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:38.928314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:38.929225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:39.075594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:39.084480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7ebe522-00e4-41d0-a8b6-737827334af2 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.219521 Oct 19 22:06:39.100671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 417/824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:38 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:39.102773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:39.104162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:39.111154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:39.111744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:39.112286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:39.113104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:39.113670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:39.114195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:39.178358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:39.186513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8dd8d2b9-fd6a-4e6e-85f0-9690d29cc8f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1611 microversion: 2.1 time: 0.089355 Oct 19 22:06:39.187101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 418/825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:39 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1611 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:39.335878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:39.345065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2d635096-8be7-4f1e-a1ba-43eda30fad17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1595 microversion: 2.1 time: 0.440516 Oct 19 22:06:39.345722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 408/826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1595 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:39.483763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:39.484476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:39.507874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:39.512399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:39.516065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:39.522671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:39.523547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:39.524009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:39.551895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-bc3024b3-2307-4b2a-8fa5-618937a9b83f req-c586ea10-4a62-4463-be86-90b38eb4c903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e0e488-cb92-478d-8aa4-357c3773dedc", "name": "network-vif-deleted", "tag": "0cb10885-0f37-4381-a5f7-eebc5f05f951"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:39.569262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-bc3024b3-2307-4b2a-8fa5-618937a9b83f req-c586ea10-4a62-4463-be86-90b38eb4c903 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:39.569956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-bc3024b3-2307-4b2a-8fa5-618937a9b83f req-c586ea10-4a62-4463-be86-90b38eb4c903 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:39.570574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-bc3024b3-2307-4b2a-8fa5-618937a9b83f req-c586ea10-4a62-4463-be86-90b38eb4c903 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:39.586639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-bc3024b3-2307-4b2a-8fa5-618937a9b83f req-c586ea10-4a62-4463-be86-90b38eb4c903 service nova] Creating event network-vif-deleted:0cb10885-0f37-4381-a5f7-eebc5f05f951 for instance 47e0e488-cb92-478d-8aa4-357c3773dedc on hv-cinder-maste Oct 19 22:06:39.594603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-bc3024b3-2307-4b2a-8fa5-618937a9b83f req-c586ea10-4a62-4463-be86-90b38eb4c903 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047722 Oct 19 22:06:39.597746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 409/827] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:06:39.790648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:39.808630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03c76876-7e4a-4524-ad1c-b1ef76e4f0e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1709 microversion: 2.1 time: 0.337571 Oct 19 22:06:39.833460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 419/828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1709 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:39.871537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:39.873467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:39.897223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:39.900824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:39.904325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:39.906541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:39.907512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:39.918733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.063474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:40.075109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:40.077219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:40.078431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19b88004-4e4d-49f2-b34c-f54f7e6d8078 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.212890 Oct 19 22:06:40.096439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 410/829] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:40.111148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:40.111148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:40.116944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:40.117434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:40.117871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.119396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:40.120239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:40.120738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.211859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:40.220964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:40.233087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:40.236211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:40.236775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.241038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:40.241928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:40.244471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.319956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:40.320205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:40.330413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-df2a7c91-6b7f-4344-9b22-e1a8b1d482e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1324 microversion: 2.1 time: 0.122818 Oct 19 22:06:40.335950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-26dbd449-9da0-49d1-9cfa-909f83e60f1c tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.231018 Oct 19 22:06:40.338573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 420/831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:40 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:40.338699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 411/831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:40 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1324 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:40.822364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-9fffa946-2eed-48e6-bc5e-5760f733a814 req-01a66206-32f2-481b-8b08-6ad269c76774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c904f6-2f26-43c8-891a-327e09b6cfef", "name": "network-vif-plugged", "status": "completed", "tag": "9f67a5bc-0fc9-4c09-868c-0306d466fe9e"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:40.833756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:40.834373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:40.843915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:40.844777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:40.845218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.845940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:40.846461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-9fffa946-2eed-48e6-bc5e-5760f733a814 req-01a66206-32f2-481b-8b08-6ad269c76774 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:40.847018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:40.847198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-9fffa946-2eed-48e6-bc5e-5760f733a814 req-01a66206-32f2-481b-8b08-6ad269c76774 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:40.847724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-9fffa946-2eed-48e6-bc5e-5760f733a814 req-01a66206-32f2-481b-8b08-6ad269c76774 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.847976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:40.863309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-9fffa946-2eed-48e6-bc5e-5760f733a814 req-01a66206-32f2-481b-8b08-6ad269c76774 service nova] Creating event network-vif-plugged:9f67a5bc-0fc9-4c09-868c-0306d466fe9e for instance 01c904f6-2f26-43c8-891a-327e09b6cfef on hv-cinder-maste Oct 19 22:06:40.868876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-9fffa946-2eed-48e6-bc5e-5760f733a814 req-01a66206-32f2-481b-8b08-6ad269c76774 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052538 Oct 19 22:06:40.870184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 421/832] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:06:41.021149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:41.031614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0f60d936-7d3f-4d85-bc9b-1e91dcda8d85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1709 microversion: 2.1 time: 0.202512 Oct 19 22:06:41.032195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 412/833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1709 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:41.114780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:41.115546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:41.125401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:41.125911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:41.126356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:41.127105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:41.127567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:41.127996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:41.353827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:41.354454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:41.363513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:41.364051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:41.364490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:41.367208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:41.367687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:41.368125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:41.420311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:41.421061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:41.421650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:41.423094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:41.423227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'fault' on Instance uuid 47e0e488-cb92-478d-8aa4-357c3773dedc {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:06:41.432768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:41.433765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:41.434979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-08dd29a0-699e-420a-b73e-db22ca946ee4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1809 microversion: 2.20 time: 0.335073 Oct 19 22:06:41.435595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 422/834] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:06:41.440187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:41.440797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:41.448018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:41.454609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:41.454609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:41.454609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:41.454609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:41.454987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:41.488561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:41.497962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a33badaf-0bce-43ec-81b0-33a73910269a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1329 microversion: 2.1 time: 0.148146 Oct 19 22:06:41.499022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 413/835] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:41 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1329 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:41.714608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:41.723554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-945ef9a6-a20f-42a1-834d-301abc74cc0d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.286810 Oct 19 22:06:41.724321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 423/836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:41 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:42.060709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:42.061322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:42.068500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.069003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.069445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.070150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.070609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.071060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.219316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:42.236143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-34b66b01-4fc9-44ae-a5d3-eec44ab7d70a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1713 microversion: 2.1 time: 0.176806 Oct 19 22:06:42.236143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 414/837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1713 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:42.429210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-6fec3b84-ec70-49fb-89b4-bccd2493add2 req-59946a08-f955-4acd-9380-67fc4043993d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9df3c36-da16-4a07-b4a2-c426787bd720", "tag": "153fb256-a786-4d57-9050-0204c6241145"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:42.443468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6fec3b84-ec70-49fb-89b4-bccd2493add2 req-59946a08-f955-4acd-9380-67fc4043993d service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.444401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6fec3b84-ec70-49fb-89b4-bccd2493add2 req-59946a08-f955-4acd-9380-67fc4043993d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.444839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6fec3b84-ec70-49fb-89b4-bccd2493add2 req-59946a08-f955-4acd-9380-67fc4043993d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.457076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-6fec3b84-ec70-49fb-89b4-bccd2493add2 req-59946a08-f955-4acd-9380-67fc4043993d service nova] Creating event network-changed:153fb256-a786-4d57-9050-0204c6241145 for instance a9df3c36-da16-4a07-b4a2-c426787bd720 on hv-cinder-maste Oct 19 22:06:42.462447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-6fec3b84-ec70-49fb-89b4-bccd2493add2 req-59946a08-f955-4acd-9380-67fc4043993d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037899 Oct 19 22:06:42.463740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 424/838] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:06:42.464091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:42.464711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:42.471084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.471603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.472037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.472729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.473182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.473605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.526913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:42.527692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:42.529591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:42.538832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.539377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.539957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.540665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.541821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.542258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.579590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.580078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.580705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.581327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'fault' on Instance uuid 47e0e488-cb92-478d-8aa4-357c3773dedc {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:06:42.632147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:42.641076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b4600b1-8928-4d6e-b48f-824194365842 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1329 microversion: 2.1 time: 0.118879 Oct 19 22:06:42.642286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 425/839] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:42 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1329 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:06:42.673253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:42.689628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:42.691446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:42.692638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a6cb4a02-8c7c-4870-8bc8-9be8bd8470f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1796 microversion: 2.20 time: 0.233630 Oct 19 22:06:42.693414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 415/840] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:06:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1796 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:06:42.748372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:42.748372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:42.754146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.754808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.755341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.756037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:42.756500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:42.756926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:42.920748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:42.929070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dd1f8e8f-5c4f-4716-8b33-c64ad23e4d3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1313 microversion: 2.1 time: 0.187027 Oct 19 22:06:42.929727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 426/841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:42 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:43.664712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:43.665319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:43.672788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:43.673268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:43.673703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:43.674398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:43.674855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:43.675310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:43.706251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:43.706733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:43.707212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:43.707684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'fault' on Instance uuid 47e0e488-cb92-478d-8aa4-357c3773dedc {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:06:43.760823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:43.768481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0c85b949-474e-4602-8e85-c08bef68a94d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 200 len: 1329 microversion: 2.1 time: 0.107674 Oct 19 22:06:43.769055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 416/842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:43 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 1329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:43.953547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:43.954163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:43.960612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:43.961407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:43.961844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:43.963315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:43.963805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:43.964238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:44.108462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:44.116301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3979112f-9e25-4fde-9aa9-1d3461bbc8a0 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1497 microversion: 2.1 time: 0.166678 Oct 19 22:06:44.117257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 427/843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:43 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:44.793786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:44.797756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:44.801477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:44.801870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:44.802284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:44.803216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:44.804162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:44.804626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:44.818381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc HTTP/1.1 Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:06:44.820036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:06:44.821647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '47e0e488-cb92-478d-8aa4-357c3773dedc'} Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:06:44.823061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:06:44.824505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:06:44.825797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:06:44.825797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e23649e8-ff71-4a2b-af5c-571cf1e51548 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 404 len: 111 microversion: 2.1 time: 0.032543 Oct 19 22:06:44.825797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 417/844] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:44 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:06:44.830747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-78055fb0-767c-46aa-90f8-a67a2194a2d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '.version_select at 0x7f7332bfcca0>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:44.907903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-78055fb0-767c-46aa-90f8-a67a2194a2d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-15250024" status: 202 len: 0 microversion: 2.1 time: 0.080429 Oct 19 22:06:44.908012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 428/845] 10.222.0.20 () {58 vars in 1215 bytes} [Wed Oct 19 22:06:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-15250024 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:06:44.917254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-130001350"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:44.919957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:44.924671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:44.925154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:44.925582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:44.926273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:44.926841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:44.927287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:45.059412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.network.security_group_api [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Adding security group d538fcec-68ca-491d-8b5e-9faa335953b0 to port 153fb256-a786-4d57-9050-0204c6241145 Oct 19 22:06:45.456994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-235d40b5-dc19-48d2-bf66-a0506bc71aff tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action" status: 202 len: 0 microversion: 2.1 time: 0.544191 Oct 19 22:06:45.457618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 418/846] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:06:44 2022] POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:06:45.470589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:45.471656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-faa66a85-e2b8-4127-8756-b0882f80737f req-49a287d1-3525-405c-892c-8eda571687f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9df3c36-da16-4a07-b4a2-c426787bd720", "tag": "153fb256-a786-4d57-9050-0204c6241145"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:45.472387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:45.484236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:45.485676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:45.486347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:45.488637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:45.489321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:45.490336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:45.491804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-faa66a85-e2b8-4127-8756-b0882f80737f req-49a287d1-3525-405c-892c-8eda571687f2 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:45.495621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-faa66a85-e2b8-4127-8756-b0882f80737f req-49a287d1-3525-405c-892c-8eda571687f2 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:45.495621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-faa66a85-e2b8-4127-8756-b0882f80737f req-49a287d1-3525-405c-892c-8eda571687f2 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:45.505692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-faa66a85-e2b8-4127-8756-b0882f80737f req-49a287d1-3525-405c-892c-8eda571687f2 service nova] Creating event network-changed:153fb256-a786-4d57-9050-0204c6241145 for instance a9df3c36-da16-4a07-b4a2-c426787bd720 on hv-cinder-maste Oct 19 22:06:45.523812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-faa66a85-e2b8-4127-8756-b0882f80737f req-49a287d1-3525-405c-892c-8eda571687f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056756 Oct 19 22:06:45.527216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 419/847] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:06:45.716914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:45.729968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cb926d2a-0132-40ac-b224-bb2c55d8a0c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1758 microversion: 2.1 time: 0.267743 Oct 19 22:06:45.731442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 429/848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1758 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:47.034647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:06:47.037002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:47.043238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:47.043693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:47.044134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:47.044823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:47.045275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:47.045698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:47.268745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4e0a6086-196e-4519-9f67-1565674ca157 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action" status: 202 len: 0 microversion: 2.1 time: 0.238600 Oct 19 22:06:47.269779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 420/849] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:06:47 2022] POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:06:47.278309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:47.279041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:47.285821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:47.286310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:47.286750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:47.287473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:47.287931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:47.288365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:47.441527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:47.450563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01becb7a-ccc5-4695-a0d3-d1073e4a597a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1750 microversion: 2.1 time: 0.176888 Oct 19 22:06:47.451139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 430/850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:48.474792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:48.475519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:48.481717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:48.482200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:48.482636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:48.483429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:48.483883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:48.484317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:48.623801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:48.627268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:48.632203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e2569884-63b1-4672-a69f-0b605a20dbde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.162287 Oct 19 22:06:48.632769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 421/851] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:49.655989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:49.656530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:49.663029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:49.663515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:49.663946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:49.664625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:49.665074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:49.666113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:49.805631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:49.813729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-514c2a97-9d77-4c99-bc5c-754d3f3d10e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.161743 Oct 19 22:06:49.814288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 431/852] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:50.836869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:50.837468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:50.844253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:50.844737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:50.845170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:50.845854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:50.846302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:50.846718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:50.992193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:51.000795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8edd9175-6211-42d9-b428-51ac005fb3f4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.168097 Oct 19 22:06:51.001370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 422/853] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:52.023711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:52.024353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:52.030848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:52.031366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:52.031808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:52.032528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:52.032986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:52.033412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:52.037398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:06:52.176544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:52.185524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9857c8c3-868f-4d5e-b705-97aa2bace61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.165712 Oct 19 22:06:52.186094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 432/854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:53.208736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:53.209348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:53.216341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:53.216826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:53.217280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:53.217956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:53.218410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:53.218838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:53.357400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:53.365882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9696a0e-2c52-4448-ac54-96d0b91f5810 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.160955 Oct 19 22:06:53.366435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 423/855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:54.389157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:54.389768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:54.396263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:54.396746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:54.397184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:54.397870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:54.398322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:54.398745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:54.536474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:54.544643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-11dc78fb-add5-4425-add2-2b07f2153d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.159349 Oct 19 22:06:54.545207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 433/856] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:55.567853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:55.568464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:55.574918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:55.575431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:55.575864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:55.576548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:55.577002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:55.577426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:55.717584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:55.725889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-840503a4-8039-4d80-831f-8669797495e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.161918 Oct 19 22:06:55.726449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 424/857] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:56.750008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:56.750617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:56.757174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:56.757656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:56.758095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:56.758820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:56.759326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:56.759782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:56.902099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:56.910361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8ee54826-557f-4d34-b5ab-2fa7a1ceee67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.164235 Oct 19 22:06:56.910930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 434/858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:57.934666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:57.935305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:57.941616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:57.942093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:57.942522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:57.943232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:57.943685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:57.944103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:58.084960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:58.093142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bae54d02-b4a9-4f2e-a727-560a1039da26 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.162821 Oct 19 22:06:58.093700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 425/859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:06:59.116076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:06:59.116618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:06:59.123086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:59.123571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:59.124007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:59.124693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:06:59.125147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:06:59.125569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:06:59.312843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:06:59.321079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ba9bbc2b-24d9-45b5-a20e-22e926dbf930 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.208938 Oct 19 22:06:59.322247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 435/860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:06:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:00.345329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:00.345893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:00.352331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:00.352809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:00.353265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:00.353947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:00.354399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:00.354819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:00.543866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:00.552010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f50b80c3-0556-4b27-8e79-09e4ec5d3d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.210648 Oct 19 22:07:00.552579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 426/861] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:01.576726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:01.577327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:01.583908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:01.584384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:01.584813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:01.585490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:01.585942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:01.586357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:01.724223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:01.732449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6aaccbb-80e8-4f57-908c-6bda2ba6c379 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.159534 Oct 19 22:07:01.733015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 436/862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:02.755857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:02.756470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:02.763386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:02.763872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:02.764309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:02.764998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:02.765452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:02.765877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:02.906789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:02.914819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-953809da-fb5c-49c3-9615-53e19cd653e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.162811 Oct 19 22:07:02.915404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 427/863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:03.937720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:03.938325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:03.944283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:03.944878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:03.945313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:03.945998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:03.946463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:03.946870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:04.090195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:04.098433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-61e1363f-a0bd-4564-bbf9-30206ec1a0bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.164743 Oct 19 22:07:04.099020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 437/864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:05.122251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:05.122840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:05.125065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=49 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:05.129662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:05.130138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:05.130566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:05.131280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:05.131732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:05.132148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:05.271614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:05.280559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7e4b7eb6-cb11-4599-8ff5-d262b51a226a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.162252 Oct 19 22:07:05.281121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 428/865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:06.304130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:06.304737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:06.311551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:06.312041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:06.312476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:06.313161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:06.313609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:06.314030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:06.454170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:06.462203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-31b0fd6a-ddf7-42c8-9fd8-f577ccfec280 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.162332 Oct 19 22:07:06.462764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 438/866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:07.486096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:07.486687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:07.493062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:07.493611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:07.493959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:07.494643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:07.495725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:07.496144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:07.637154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:07.645382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-825640d8-a60d-463c-9dcd-5eba16798de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.163104 Oct 19 22:07:07.645942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 429/867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:08.669259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:08.669895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:08.676350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:08.676830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:08.677261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:08.677945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:08.678398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:08.679117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:08.825534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:08.833676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-95d9e44c-8075-4358-bfd7-072f229def7f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1755 microversion: 2.1 time: 0.168804 Oct 19 22:07:08.834235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 439/868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:09.856974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:09.857587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:09.864240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:09.864721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:09.865154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:09.865839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:09.866291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:09.866712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:10.007953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:07:10.013162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d1f1e9c9-3206-4141-8099-307bd6bbc440 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1758 microversion: 2.1 time: 0.160707 Oct 19 22:07:10.013729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 430/869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:07:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:07:22.778023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:22.778766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=46 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:22.779822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:07:22.779968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:07:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments/2ba49c2d-3484-462e-a30a-e5bbc45ada19 (ip 10.222.0.20) !!! Oct 19 22:07:22.885893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:22.886393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:22.892262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:22.892739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:22.893169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:22.893855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:22.894305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:22.894730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:22.923371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e7ee053f-3b21-4068-8a3a-ea9dca7e6309 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments/2ba49c2d-3484-462e-a30a-e5bbc45ada19" status: 200 len: 194 microversion: 2.20 time: 0.150597 Oct 19 22:07:22.923932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 440/870] 10.222.0.20 () {60 vars in 1454 bytes} [Wed Oct 19 22:07:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments/2ba49c2d-3484-462e-a30a-e5bbc45ada19 => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:07:24.262572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:24.263215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:24.265656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:07:24.265802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:07:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments/bfa0bff0-e86f-4838-936f-0fbbd5315a79 (ip 10.222.0.20) !!! Oct 19 22:07:24.267559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=5 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:24.268278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=54 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:24.280587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:24.281066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:24.281492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:24.282183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:24.282631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:24.283084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:34.312733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:34.353240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:49.771480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-130001350"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:07:49.772024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:49.773951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:49.774600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=6 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:07:49.780049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:49.780532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:49.780965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:49.781662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:49.782223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:49.782581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:49.906997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.network.security_group_api [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Removing security group d538fcec-68ca-491d-8b5e-9faa335953b0 from port 153fb256-a786-4d57-9050-0204c6241145 Oct 19 22:07:50.297003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01cebaaf-9433-4385-9f60-c02559b72b34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action" status: 202 len: 0 microversion: 2.1 time: 0.529609 Oct 19 22:07:50.297742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 441/871] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:07:49 2022] POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 22:07:50.396028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-036cd7a0-5332-43fd-9826-0ec8a29e952e req-16ffbd95-f81d-4fe3-bfe9-f083dbbae317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9df3c36-da16-4a07-b4a2-c426787bd720", "tag": "153fb256-a786-4d57-9050-0204c6241145"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:07:50.406486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-036cd7a0-5332-43fd-9826-0ec8a29e952e req-16ffbd95-f81d-4fe3-bfe9-f083dbbae317 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:50.407279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-036cd7a0-5332-43fd-9826-0ec8a29e952e req-16ffbd95-f81d-4fe3-bfe9-f083dbbae317 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:50.407713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-036cd7a0-5332-43fd-9826-0ec8a29e952e req-16ffbd95-f81d-4fe3-bfe9-f083dbbae317 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:50.419295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-036cd7a0-5332-43fd-9826-0ec8a29e952e req-16ffbd95-f81d-4fe3-bfe9-f083dbbae317 service nova] Creating event network-changed:153fb256-a786-4d57-9050-0204c6241145 for instance a9df3c36-da16-4a07-b4a2-c426787bd720 on hv-cinder-maste Oct 19 22:07:50.425155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-036cd7a0-5332-43fd-9826-0ec8a29e952e req-16ffbd95-f81d-4fe3-bfe9-f083dbbae317 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118898 Oct 19 22:07:50.425755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 442/872] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:07:51.507009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:07:51.507610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:07:51.514344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:51.514834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:51.515436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:07:51.516168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:07:51.516537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:07:51.516962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:01.511224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=6 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:08:01.540992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=10 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:08:38.720728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lazy-loading 'services' on Instance uuid 8fefc135-201b-453b-a232-37a012534b45 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:08:38.896690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lazy-loading 'services' on Instance uuid a9df3c36-da16-4a07-b4a2-c426787bd720 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:08:39.340525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37e42249-4989-4787-8158-e59610b81d8f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments/bfa0bff0-e86f-4838-936f-0fbbd5315a79" status: 202 len: 0 microversion: 2.1 time: 75.082324 Oct 19 22:08:39.341158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 431/873] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:07:24 2022] DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments/bfa0bff0-e86f-4838-936f-0fbbd5315a79 => generated 0 bytes in 75084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:08:39.347079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-8612264e-1d34-49ac-8865-d3d1dc78bf71 req-f4367797-e47b-4045-a24a-ae25d73b3a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9df3c36-da16-4a07-b4a2-c426787bd720", "tag": "153fb256-a786-4d57-9050-0204c6241145"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:08:39.356644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-8612264e-1d34-49ac-8865-d3d1dc78bf71 req-f4367797-e47b-4045-a24a-ae25d73b3a48 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.357111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-8612264e-1d34-49ac-8865-d3d1dc78bf71 req-f4367797-e47b-4045-a24a-ae25d73b3a48 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.357576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-8612264e-1d34-49ac-8865-d3d1dc78bf71 req-f4367797-e47b-4045-a24a-ae25d73b3a48 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.368809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-8612264e-1d34-49ac-8865-d3d1dc78bf71 req-f4367797-e47b-4045-a24a-ae25d73b3a48 service nova] Creating event network-changed:153fb256-a786-4d57-9050-0204c6241145 for instance a9df3c36-da16-4a07-b4a2-c426787bd720 on hv-cinder-maste Oct 19 22:08:39.374367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-8612264e-1d34-49ac-8865-d3d1dc78bf71 req-f4367797-e47b-4045-a24a-ae25d73b3a48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031389 Oct 19 22:08:39.374947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 432/874] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:39.380120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:39.380683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:39.386779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.387294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.387722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.388411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.388912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.389326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.419873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c5766580-1c45-4002-9980-77dd52ce1956 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments/8b4775d8-6227-4dab-a23c-e67a3d587c2f" status: 202 len: 0 microversion: 2.1 time: 47.917475 Oct 19 22:08:39.421273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 443/875] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:07:51 2022] DELETE /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments/8b4775d8-6227-4dab-a23c-e67a3d587c2f => generated 0 bytes in 47920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 22:08:39.427106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:39.427682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:39.437336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.437831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.438301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.439133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.439598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.440029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.480883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lazy-loading 'services' on Instance uuid 8fefc135-201b-453b-a232-37a012534b45 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:08:39.531472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'services' on Instance uuid ca4d839a-a9cb-470c-b01b-b634c0057dd2 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:08:39.568700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Request method failure captured: Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments/bfa0bff0-e86f-4838-936f-0fbbd5315a79 HTTP/1.1 Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHRBZCUmxZMGyp74xzPL8pZjFNful5ZnUIy7kQy7kPy92RK0G6BOTCE6oHzrqGBPEL__EC94bUZSpnok4cCZtiBLbHuDC74Ky8eZXcv9Wr4OwdtR16QwNB5LTADBBwPySLngw90oYwmOVbc7z_xbso88Rs0Yg6NrgPlfN_y1DY0giis Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:08:39.571008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}] Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 5ae13baf5df84b588fa65e8dffec4bbf Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:08:39.572652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'server_id': '8fefc135-201b-453b-a232-37a012534b45', 'id': 'bfa0bff0-e86f-4838-936f-0fbbd5315a79'} Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 19 22:08:39.573516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:08:39.574566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:08:39.575690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:08:39.576717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) Oct 19 22:08:39.577803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:08:39.580230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-493db2c3-2db7-4b01-95b3-036a99160a94) {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:08:39.586345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-92a44379-df3c-4e01-b1c6-54895b444951 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments/bfa0bff0-e86f-4838-936f-0fbbd5315a79" status: 400 len: 269 microversion: 2.1 time: 0.205068 Oct 19 22:08:39.586345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 433/876] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:08:39 2022] DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments/bfa0bff0-e86f-4838-936f-0fbbd5315a79 => generated 269 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:08:39.586934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:39.587508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:39.594308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.594645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.595119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.595809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.596433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.596857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.836477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lazy-loading 'services' on Instance uuid 36e9edcd-9575-4a90-80cc-d85cdee02841 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:08:39.838710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f6ff1d6f-ba5b-4891-9453-515e10cb7308 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments/9d739c2d-2804-4e8b-bd81-9aa938bfcec7" status: 202 len: 0 microversion: 2.1 time: 0.415771 Oct 19 22:08:39.839356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 444/877] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:08:39 2022] DELETE /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments/9d739c2d-2804-4e8b-bd81-9aa938bfcec7 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:08:39.845228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:39.847711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:39.854033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.854682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.855159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.856050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.856506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.856932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.886906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b17a2921-c498-4c6b-80dd-dbf336279c27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046200 Oct 19 22:08:39.887497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 445/878] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:39.891959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:39.894086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:39.899790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.900388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.900704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.901394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.901850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.902277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.940060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-98a9feaa-59aa-44f5-8869-5054c54f5471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051554 Oct 19 22:08:39.940632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 446/879] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:39.945361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:39.947495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:39.953111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.953581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.954010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.954724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:39.955199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:39.955621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:39.984821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-063b59f1-2fc2-4ac6-94aa-2fcb7cc793ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Oct 19 22:08:39.985366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 447/880] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:40.170537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ee135437-8614-404f-aec8-44127a7c917d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments/2ba49c2d-3484-462e-a30a-e5bbc45ada19" status: 202 len: 0 microversion: 2.20 time: 0.586937 Oct 19 22:08:40.171358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 434/881] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Oct 19 22:08:39 2022] DELETE /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments/2ba49c2d-3484-462e-a30a-e5bbc45ada19 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:08:40.180029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:40.182204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:40.188716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:40.189200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:40.189647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:40.190338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:40.190818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:40.191269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:40.219931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d4a43bf5-0efe-4101-9c92-94ca7eadd6f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044150 Oct 19 22:08:40.220599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 448/882] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:40.901595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:40.903859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:40.910366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:40.910844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:40.911305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:40.911989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:40.912442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:40.912865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:40.942491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8100e1b9-fbe3-4167-9ca8-e4da8adc7986 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045150 Oct 19 22:08:40.943213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 435/883] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:40.952522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:40.954664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:40.960979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:40.961461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:40.961899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:40.962593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:40.963093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:40.963522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:40.992845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-615e94bb-656a-423e-9670-11021dcd4244 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Oct 19 22:08:40.993391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 449/884] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:41.004999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:41.007120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:41.012872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:41.013346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:41.013816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:41.014597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:41.015080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:41.015500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:41.043797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bea56e0c-9647-48d7-86e2-e916ef283ba5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Oct 19 22:08:41.044276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 436/885] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:41.233471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:41.235633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:41.241548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:41.242028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:41.242462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:41.243181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:41.243637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:41.244058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:41.272184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1cc9bce5-3009-4f36-895d-4ac9bbd305ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043293 Oct 19 22:08:41.272731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 450/886] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:41.955196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:41.957274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:41.963569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:41.964045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:41.964471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:41.965144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:41.965590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:41.966007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:41.995202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19776ab2-f9a5-46c2-8f10-d3a2528bb3ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Oct 19 22:08:41.995740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 437/887] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:42.004383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:42.006581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:42.012905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:42.013389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:42.013824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:42.014513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:42.014996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:42.015424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:42.044034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-54702fab-3e9c-42b1-873b-b82b26e80bcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 Oct 19 22:08:42.044575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 451/888] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:42.056645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:42.058730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:42.064513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:42.064993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:42.065433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:42.066120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:42.066576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:42.067034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:42.096982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a61cf138-4b92-4910-bba3-e44d9201a3bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Oct 19 22:08:42.097527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 438/889] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:42.285236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:42.287321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:42.293195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:42.293668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:42.294096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:42.294767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:42.295239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:42.295660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:42.324030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-26959e34-7164-4eb5-a576-63c7e4b4f49d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042887 Oct 19 22:08:42.324577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 452/890] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:08:43.007725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:43.009821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:43.016718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.017189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.017614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.018290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.018740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.019185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.047659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5e717f71-0b34-4185-9822-cf96e2dc4577 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Oct 19 22:08:43.048132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 439/891] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:43.057226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:43.059452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:43.065754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.066238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.066684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.067408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.067891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.068320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.098029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-23566bbe-484a-4d2d-8bea-d7688feae585 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Oct 19 22:08:43.098587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 453/892] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:43.109379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:43.111572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:43.117451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.120149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.120149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.120149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.120149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.120577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.149798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e0fbf66f-6dd8-48fc-a987-4729551a44ba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Oct 19 22:08:43.150359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 440/893] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:43.337231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:43.339420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:43.346147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.347543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.347543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.347829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:43.348284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:43.348709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:43.378303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8668adb9-6b71-4ec1-a5ca-0dedf99456f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045084 Oct 19 22:08:43.378859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 454/894] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:44.059737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:44.061788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:44.068352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.072239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.072239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.072239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.072239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.072612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.099985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-845afd82-f10b-42aa-87b3-0149539d8aae tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Oct 19 22:08:44.100540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 441/895] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:44.110539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:44.112711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:44.118984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.119471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.119905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.120594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.121046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.121469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.149886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ea80a5c9-e0c0-4a73-83b4-ac63fd3c8e39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Oct 19 22:08:44.150432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 455/896] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:44.162605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:44.164734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:44.170486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.170978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.171426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.172740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.173195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.173614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.202023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2e4465b1-dbb3-42bd-b056-603a4072b155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Oct 19 22:08:44.202576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 442/897] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:44.391591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:44.393747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:44.399769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.400251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.400684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.401379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:44.401831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:44.402251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:44.431162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-587b6509-2a5d-4dfe-bb98-f7a460db35a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044197 Oct 19 22:08:44.431717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 456/898] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:45.112528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:45.114703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:45.121097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.121573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.122004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.122684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.123188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.123606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.155482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d03ecef9-da03-4bfa-aaed-9d5f8484508f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047526 Oct 19 22:08:45.156552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 443/899] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:45.162272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:45.164437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:45.170662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.171249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.172361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.173046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.173496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.173915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.202675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-85868c89-d398-457d-a276-ca5eb18377e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Oct 19 22:08:45.203777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 457/900] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:45.213576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:45.215758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:45.222095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.222628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.223088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.223770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.224223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.224642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.252604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0821b2be-40ea-4e94-8091-51115f16564e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042946 Oct 19 22:08:45.253148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 444/901] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:45.443677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:45.445836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:45.451808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.452296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.453252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.453947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:45.454406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:45.454833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:45.479590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:08:45.484186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4cfb17b1-8af5-40e4-bd3d-6f3bca4b30b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Oct 19 22:08:45.484731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 458/902] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:46.168483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:46.170563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:46.177392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.177873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.178308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.179054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.179511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.180194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.208622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-72cc7388-5045-4ded-bffb-9d45263ed349 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044161 Oct 19 22:08:46.209357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 445/903] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:46.264899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:46.267042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:46.273126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.273798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.274254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.275000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.275509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.275908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.308306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-de13dd49-4587-4a9e-90b4-3e70fe17ac02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Oct 19 22:08:46.308877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 446/904] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:08:46.326593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:46.330818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:46.334838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.335354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.335783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.336557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.337043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.337465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.367298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3f94e441-80df-4f40-b323-42e4d20e1165 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156433 Oct 19 22:08:46.367842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 459/905] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:46.502591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:46.504699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:46.510516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.511022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.511448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.512128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:46.512576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:46.512994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:46.517277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:08:46.541977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0f97def0-9ebd-4a80-9a11-4b9feda7681c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043808 Oct 19 22:08:46.542551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 447/906] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:47.220061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:47.222267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:47.228687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.229168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.229605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.230287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.230743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.231199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.260599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8c4fe201-4906-42d3-8d90-c2dec1db91b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Oct 19 22:08:47.261518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 460/907] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:47.321396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:47.323538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:47.331559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.332030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.332458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.333164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.333594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.334026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.362256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ab57e14-eb56-4f27-b72b-3c0b6b3692c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Oct 19 22:08:47.362812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 448/908] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:47.379953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:47.382091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:47.388016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.388500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.391803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.391803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.391803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.391803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.419475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-20aad32a-c0ac-4bfd-8c5d-71bbddbc4170 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Oct 19 22:08:47.420022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 461/909] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:47.553952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:47.556318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:47.562807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.563362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.563791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.564468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:47.564918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:47.565338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:47.593316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7b22076b-e722-4e86-80cc-68e6342caed4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043571 Oct 19 22:08:47.593929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 449/910] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:48.273927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:48.276097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:48.283060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.283545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.283972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.284659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.285111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.285532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.313679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0a40eac1-71d1-48f5-b2ee-73cb9777d301 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Oct 19 22:08:48.314226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 462/911] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:48.373562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:48.375761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:48.381973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.382446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.382872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.383574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.384021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.384443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.414047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-70032cf2-5025-4853-bb54-4cb9ee5cedaa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Oct 19 22:08:48.414587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 450/912] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:48.432139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:48.434320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:48.440849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.441368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.441881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.442626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.443112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.443538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.472291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-35e0e44d-9ee7-4e73-a26d-16ed1223af68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Oct 19 22:08:48.472845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 463/913] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:48.605086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:48.607306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:48.613831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.614309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.614741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.615461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:48.615914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:48.616338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:48.644862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-14cd52f6-f8d6-4622-9b92-716e2b456d7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043826 Oct 19 22:08:48.645410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 451/914] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:49.325743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:49.327936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:49.334987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.335480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.335915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.336606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.337059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.337486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.365323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2ab0056b-bdc3-4cd1-9507-ba457bca49c7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Oct 19 22:08:49.365877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 464/915] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:49.425944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:49.428104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:49.434706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.435219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.435679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.436363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.436844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.437264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.465535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-40a50c81-a0a4-4e36-9fe1-f73778f6a903 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Oct 19 22:08:49.466079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 452/916] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:49.484106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:49.486878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:49.492763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.493239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.493666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.494345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.494792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.495245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.523614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ca1a0e10-7c80-4de5-b6be-daf9ef3ec80f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Oct 19 22:08:49.524668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 465/917] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:49.657636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:49.659710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:49.665603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.666079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.666538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.667243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:49.667698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:49.668119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:49.696987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-56fd2f5a-aec8-43cb-8e58-be70e70623d4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043934 Oct 19 22:08:49.697525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 453/918] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:50.377797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:50.379965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:50.386455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.386914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.387376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.388058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.388504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.388921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.417672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c0ef939c-088c-4a63-b16f-3f1fd89d6c22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Oct 19 22:08:50.418217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 466/919] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:50.477418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:50.479539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:50.485931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.486410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.486844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.487564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.488016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.488436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.517321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eae353e5-f159-4cec-8b7a-a1191c921645 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043275 Oct 19 22:08:50.522493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 454/920] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:50.536273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:50.538545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:50.544586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.545074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.545518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.546241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.546697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.547163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.575683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2046f97c-2466-4f45-a6e5-ca89828a9087 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Oct 19 22:08:50.576230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 467/921] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:50.709334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:50.711482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:50.717227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.717700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.718132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.718809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:50.719285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:50.719772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:50.747933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7706030b-f04b-4c7a-a7d5-214e37549f15 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042580 Oct 19 22:08:50.748472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 455/922] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:51.430045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:51.432221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:51.438783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.439294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.439729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.440442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.440896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.441319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.470406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-43c27850-19e6-422a-a36c-9f3be0fbd81a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Oct 19 22:08:51.470976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 468/923] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:51.529579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:51.531724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:51.538638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.539154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.539585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.540262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.540707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.541122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.570679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-81084c23-ef72-44f7-a663-bf3994baeeea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Oct 19 22:08:51.571257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 456/924] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:51.588271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:51.590610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:51.597231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.597706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.598137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.598816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.599350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.599770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.628352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b148b73c-4a8d-429b-9154-f9e918689ca5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Oct 19 22:08:51.628891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 469/925] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:51.759987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:51.762094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:51.769110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.769594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.770027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.770715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:51.771195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:51.771617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:51.800207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82a58b50-3157-447c-a4f8-305a07615052 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044052 Oct 19 22:08:51.800708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 457/926] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:52.482944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:52.485098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:52.491486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.491965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.492395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.493072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.493522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.493940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.523254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-55042567-5f1d-4b86-bfda-1c22833981b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Oct 19 22:08:52.523794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 470/927] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:52.582202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:52.584335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:52.591320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.591792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.592220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.592900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.593347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.593764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.622412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-15fe579e-149e-4c15-8b62-21a6fbc154a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Oct 19 22:08:52.622973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 458/928] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:52.640653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:52.643472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:52.649355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.649836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.650271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.650976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.651425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.651849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.680723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6e54f14a-8487-460f-83d0-74f2c76ce48b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Oct 19 22:08:52.681260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 471/929] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:08:52.812962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:52.815759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:52.821658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.822131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.822562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.823267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:52.823722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:52.824147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:52.852152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bc215329-b3ad-47a9-a873-e6a47ed99ef8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043160 Oct 19 22:08:52.852695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 459/930] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:53.535583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:53.537723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:53.544279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.544759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.545193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.545876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.546330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.546751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.576289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8ed26fab-015c-4b8b-b6f7-bf0fb022a802 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Oct 19 22:08:53.576838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 472/931] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:53.635738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:53.637881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:53.644749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.645232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.645667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.646357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.646812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.647266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.675959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ad6750c-308c-4acf-83f7-11530a7daaac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Oct 19 22:08:53.676500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 460/932] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:53.693372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:53.695558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:53.701340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.701848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.702282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.702985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.703446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.703869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.732844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cf09ae16-1e51-4b35-98d8-1e4c8eb6d43c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 Oct 19 22:08:53.733378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 473/933] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:53.865100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:53.867232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:53.873110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.873594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.874033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.874718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:53.875207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:53.875637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:53.905119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cdae9763-62dd-4acc-9ec8-66d21b12e7d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044044 Oct 19 22:08:53.905676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 461/934] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:54.588999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:54.591187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:54.598068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.598548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.598997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.599716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.600173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.600598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.629315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-24521035-e803-46af-85b7-5d41234a99e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Oct 19 22:08:54.629865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 474/935] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:54.688438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:54.690580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:54.696874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.697364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.697805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.698497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.698980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.699409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.728523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f5081ad5-7779-45a2-a3fd-bc2bc82b80db tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Oct 19 22:08:54.729071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 462/936] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:54.745123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:54.747295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:54.753011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.753483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.753910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.754583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.755131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.755553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.771524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:08:54.784367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c9449b85-0a24-4c00-b7ce-e7aff72af63c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Oct 19 22:08:54.784918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 475/937] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:54.917618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:54.919738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:54.926723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.927235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.927673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.928361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:54.928813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:54.929237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:54.953316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:08:54.958382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-56fddbc3-0881-41fa-a6e9-a4ffd168ebca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044866 Oct 19 22:08:54.958921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 463/938] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:55.641219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:55.644115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:55.650997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.651543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.652127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:55.652816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.653267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.653694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:55.682297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f1f898cc-055b-4006-b70e-afd309dad1bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Oct 19 22:08:55.682828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 476/939] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:55.740981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:55.743099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:55.749887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.750399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.751479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:55.752166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.752612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.753031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:55.780925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a70b885-ce3b-4790-bfde-5c4b0d7892a1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Oct 19 22:08:55.781456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 464/940] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:55.803722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:55.806071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:55.811951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.812434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.812875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:55.814220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.814681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.815145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:55.843283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ada9fa4e-ab7c-437a-847b-4b457c1b67a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 Oct 19 22:08:55.843829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 477/941] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:55.973650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:55.975787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:55.981613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.982095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.982529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:55.983240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:55.983696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:55.984119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:56.014054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6fc4d858-b11f-46b5-a28b-01ec0d4fe9be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044342 Oct 19 22:08:56.014605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 465/942] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:56.694650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:56.696865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:56.703262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:56.703737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:56.704754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:56.705463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:56.705916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:56.706337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:56.735033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a09d1dec-6e23-49b9-94c1-a03d7c685be3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Oct 19 22:08:56.735592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 478/943] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:56.793005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:56.795266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:56.801676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:56.802160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:56.802593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:56.803305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:56.803757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:56.804178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:56.833601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6eac9c15-3b2b-4048-bfcb-2ea1c44b06d4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Oct 19 22:08:56.834148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 466/944] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:56.855484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:56.857629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:56.864100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:56.864585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:56.865022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:56.865720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:56.866178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:56.866607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:56.895006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e15d7cce-5ab8-49e5-b948-a699b315607e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Oct 19 22:08:56.895551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 479/945] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:57.025940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:57.028041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:57.033905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.034382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.034808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.035518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.035967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.036382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.065216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bee10945-3719-4ff7-a631-7f0c58b36c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043331 Oct 19 22:08:57.065761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 467/946] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:57.748006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:57.750168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:57.757169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.757654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.758094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.758779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.759355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.759784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.789898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4e791b9-f639-4ee9-a8a9-3222a4c40111 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045962 Oct 19 22:08:57.790474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 480/947] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:57.846379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:57.848518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:57.854772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.855281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.855712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.856407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.856836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.857254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.885892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a0a4340f-b158-4ca5-9e09-5f8aae96afad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Oct 19 22:08:57.886426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 468/948] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:57.906725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:57.909417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:57.915279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.915776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.916207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.916883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:57.917328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:57.917742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:57.947079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-37b8500e-1307-460a-b154-020d04400fc0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Oct 19 22:08:57.947630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 481/949] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:58.077826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:58.079879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:58.085903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.086381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.086811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.087542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.087996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.088418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.116902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c0672d9a-f54b-48a2-b75b-04ac7cca10c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043112 Oct 19 22:08:58.117448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 469/950] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:58.801743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:58.803977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:58.810651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.811189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.811632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.812358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.812820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.813251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.842318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-80f3b7b6-09f8-41c3-b70a-7dcdc0ee5245 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Oct 19 22:08:58.842897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 482/951] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:58.898214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:58.900370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:58.906620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.907774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.908207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.908895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.909344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.909758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.940325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2677304-988f-402c-9005-65d04478e083 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Oct 19 22:08:58.940886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 470/952] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:58.959708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:58.961883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:58.967886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.968369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.968804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.969492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:58.969944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:58.970368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:58.999210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab4ea7ce-2bb0-4321-9cf0-1bb6caf1750b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Oct 19 22:08:58.999756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 483/953] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:59.129608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:59.131818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:59.137827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:59.138304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:59.138736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:59.139448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:59.139901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:59.140319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:59.169750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-608e234f-ad07-4257-aae0-0ddcac9652eb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044125 Oct 19 22:08:59.170316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 471/954] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:08:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:08:59.855429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:59.857592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:59.864613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:59.865088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:59.865517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:59.866194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:59.866645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:59.867095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:59.894668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c1ddc2be-f1df-495a-9db7-2b478dece23d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043311 Oct 19 22:08:59.895231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 484/955] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:08:59.952527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:08:59.954634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:08:59.960937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:59.961416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:59.961844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:59.962527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:08:59.962989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:08:59.963414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:08:59.992648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-890aa934-dcdc-46b7-8d56-9dcb0374a246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Oct 19 22:08:59.993187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 472/956] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:08:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:00.012409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:00.014718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:00.020856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:00.021352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:00.021954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:00.022497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:00.022969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:00.023430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:00.053572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2d07bf50-5bd4-4adc-9f67-34c6ee08b898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045325 Oct 19 22:09:00.054037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 485/957] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:00.183143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:00.185293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:00.191741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:00.196793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:00.196793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:00.196793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:00.196793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:00.197145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:00.222774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c807c880-cc7a-4069-803c-a2edf4dbc128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043896 Oct 19 22:09:00.223349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 473/958] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:00.907536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:00.909739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:00.916248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:00.916724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:00.917156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:00.917859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:00.918294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:00.918716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:00.947421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-58fe8ae6-11eb-4110-837e-fceff04a5d27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044385 Oct 19 22:09:00.947970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 486/959] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:01.004790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:01.006915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:01.013178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.013654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.014083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:01.014761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.015240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.015661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:01.045127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f6f3f1c7-ff69-4a2c-bca3-5ec592240201 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Oct 19 22:09:01.045599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 474/960] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:01.065867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:01.068009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:01.073912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.074386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.074816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:01.075527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.075976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.076393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:01.106793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bc20c328-e192-4875-986d-aafa3e11325e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Oct 19 22:09:01.107373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 487/961] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:01.234550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:01.237256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:01.243362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.243852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.244280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:01.244964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.245419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.245845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:01.274629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82d63311-9698-4174-ab0e-ecacde364610 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044047 Oct 19 22:09:01.275215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 475/962] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:01.960441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:01.962584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:01.964926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=89 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:01.970200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.970682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.971144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:01.975104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:01.975104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:01.975104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:02.002222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9a158992-2d0f-49dd-a41d-18b866a3b231 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Oct 19 22:09:02.002765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 488/963] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:02.057026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:02.059153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:02.066239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:02.066713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:02.067179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:02.067864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:02.068310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:02.068729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:02.097738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fd9e067a-20ad-478b-b9cc-065c75048ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Oct 19 22:09:02.098300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 476/964] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:02.119770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:02.121951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:02.127796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:02.128281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:02.128716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:02.129409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:02.129867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:02.130294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:02.159038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1452be6a-8bbd-4529-a43d-115733116ec1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Oct 19 22:09:02.159587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 489/965] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:02.287606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:02.289740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:02.295588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:02.296070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:02.296506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:02.297189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:02.298284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:02.298709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:02.327550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-92914a35-47ac-4417-bf7d-6441f82eb099 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043779 Oct 19 22:09:02.328096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 477/966] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:03.014708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:03.016921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:03.024009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.024492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.024929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.025619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.026074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.026517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.056283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-822e221f-8790-4dcd-80ab-57564de84311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 Oct 19 22:09:03.056827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 490/967] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:03.111194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:03.113569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:03.120615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.121113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.121552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.122268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.122731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.123193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.154974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-be3e74ec-d66a-4a9a-ab1b-1bf9819375f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048440 Oct 19 22:09:03.155570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 478/968] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:03.171683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:03.174561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:03.181403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.181894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.182324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.183048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.183492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.183918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.221386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1a679ad6-a1a0-47ba-a8f7-41edb5be6c75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053655 Oct 19 22:09:03.221948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 491/969] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:03.340992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:03.343160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:03.349720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.350207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.350643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.351365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:03.351825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:03.352255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:03.380840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-677817cc-8a1a-4865-9ddd-95b58ede5b88 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043853 Oct 19 22:09:03.381395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 479/970] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:04.068806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:04.070970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:04.076928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.077407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.077839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.078610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.079093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.079512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.083123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:04.108389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2a1159d6-7dbd-444b-b1dd-8d133a5e4a0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Oct 19 22:09:04.108945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 492/971] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:04.167832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:04.169944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:04.176768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.177246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.177671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.178345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.178792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.179240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.196601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:04.209080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3398f77f-4ade-4f28-9f99-9ba211ae1927 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045218 Oct 19 22:09:04.209628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 480/972] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:04.233633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:04.236313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:04.242639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.244686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.244686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.244686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.244686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.245162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.274036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f1864fe5-e78f-4b4d-880f-55afae16876a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Oct 19 22:09:04.274584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 493/973] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:04.393804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:04.395869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:04.398186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=99 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:04.403036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.403507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.403933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.404608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:04.405089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:04.405513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:04.435601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6513388f-e0bb-4b8f-b1ff-5880e81ec220 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046295 Oct 19 22:09:04.436146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 481/974] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:05.120975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:05.123117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:05.129967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.133346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.133346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.133346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.133346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.133841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.222026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:05.224215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:05.230754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.231031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-26ee0a76-9afb-4586-b883-67b9cdc76de7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114017 Oct 19 22:09:05.231258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.231618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 494/975] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:05.231785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.232406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.232850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.233268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.264517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-db847513-1933-4f1f-b684-a451ca5933f5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046994 Oct 19 22:09:05.265073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 482/976] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:05.286090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:05.288311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:05.294103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.294589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.295057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.295751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.296203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.296627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.325947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3753e2d8-bf74-488c-83bd-88a140f1187e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Oct 19 22:09:05.326494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 495/977] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:05.448579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:05.450749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:05.456670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.457147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.457578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.458265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:05.458715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:05.459170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:05.487555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0bb31733-cc1e-48f2-b5bd-870bddbea386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 Oct 19 22:09:05.488099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 483/978] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:06.243598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:06.245736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:06.252089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.252567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.252997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.253670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.254119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.254535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.276764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:06.279025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:06.283993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-12559ff1-77d0-42dc-a0e8-54d4547c4366 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Oct 19 22:09:06.284549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 496/979] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:06.286178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.286659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.287120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.287848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.288296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.288718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.317716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7dd3a966-e200-4c68-b4ec-73833a524b28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Oct 19 22:09:06.318266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 484/980] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:06.337635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:06.339894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:06.346439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.346920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.347383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.348072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.348533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.348957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.377994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f531db1f-719b-4a19-8471-0c7cf7c2d93c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Oct 19 22:09:06.378555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 497/981] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:06.500351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:06.502318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:06.508303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.508786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.509219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.509901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:06.510376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:06.510803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:06.539895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e6ddadb4-51fe-4a36-8deb-662eb19be3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043812 Oct 19 22:09:06.540432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 485/982] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:07.296453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:07.299294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:07.306077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.306676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.307149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.307840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.308295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.308724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.329582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:07.331719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:07.338437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.338882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7bb84e69-2f04-4366-88bf-29dac0e51ddb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 Oct 19 22:09:07.339341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.339456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.340073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.340531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.340952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.343580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 498/983] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:07.371254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-28e99309-2e4f-4a1d-9f32-6113460e9e67 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Oct 19 22:09:07.371806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 486/984] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:07.389617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:07.391856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:07.397662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.398144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.398588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.399306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.399766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.400201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.429523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b86c8598-ac8e-4e9f-9f68-f10851f08b0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Oct 19 22:09:07.430444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 499/985] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:07.552889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:07.555223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:07.561173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.561650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.562081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.562765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:07.563760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:07.564183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:07.592835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-000deb74-3d24-4838-be33-96f9e1bf36ba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043993 Oct 19 22:09:07.593374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 487/986] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:08.351614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:08.353780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:08.360876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.361360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.361796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.362487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.362943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.363394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.383718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:08.385854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:08.392264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.392721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cc9cc9e7-6ae4-454d-bbfd-d2f57ea2d633 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Oct 19 22:09:08.392837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.393174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.393788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 500/987] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:08.395499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.396074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.396608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.427619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d81f7b7-b5cd-477c-8592-1de28e815014 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047863 Oct 19 22:09:08.428236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 488/988] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:08.442093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:08.443873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:08.449712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.450197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.450639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.451430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.451878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.452300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.482547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-64ae1aa6-fbe0-46d6-93e9-82ed3d141649 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044818 Oct 19 22:09:08.483121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 501/989] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:08.604367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:08.606450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:08.612333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.612818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.613258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.613947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:08.614403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:08.614832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:08.643413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1173dec6-a492-4bd7-b84d-14ececa79639 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 Oct 19 22:09:08.643961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 489/990] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:09.405569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:09.408345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:09.414715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.415236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.415696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.416383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.416837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.417262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.440741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:09.443548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:09.447871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e618c6e-60e3-41a7-a326-53099b504b46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046201 Oct 19 22:09:09.448636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 502/991] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:09.449921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.450556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.451006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.451747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.452362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.452788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.484427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e144aec-aa34-482b-95a0-ebb66c4d4587 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Oct 19 22:09:09.485087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 490/992] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:09.494793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:09.497086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:09.502923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.503529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.504029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.504720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.505168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.505586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.536040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a5e6538f-0f15-427a-9d65-d9de45c485c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045188 Oct 19 22:09:09.536605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 503/993] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:09.656266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:09.659090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:09.664964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.665445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.665874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.666560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:09.667032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:09.667453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:09.697732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d07ce0b6-fe94-4144-9701-bca9586ba8c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045653 Oct 19 22:09:09.698282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 491/994] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:10.460187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:10.462397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:10.468775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.469773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.470212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.470904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.471389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.471817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.496821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:10.498941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:10.500496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a7dfe4a0-90aa-40e1-a4ec-44b3eb7851c5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Oct 19 22:09:10.501062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 504/995] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:10.505268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.505746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.506201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.506885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.507367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.507782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.536429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-42bc903f-09bd-465e-980a-5575f85d4c0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Oct 19 22:09:10.536970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 492/996] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:10.549032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:10.551211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:10.557259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.557743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.558182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.558870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.559355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.559780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.588057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3a7ebcf7-186b-466a-92ac-130c17dd32e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Oct 19 22:09:10.588605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 505/997] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:10.717643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:10.719708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:10.725507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.725982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.726412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.727114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:10.727569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:10.727986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:10.756821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-edfb7180-339a-4ae2-908d-8551ca11213c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043208 Oct 19 22:09:10.757348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 493/998] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:11.513053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:11.515281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:11.522286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.522774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.523245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.523940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.524424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.524851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.549292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:11.551503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:11.554192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3a0644cf-a1e5-4377-9d8b-5a9b3b3cb03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Oct 19 22:09:11.554764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 506/999] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:11.558733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.558851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.559217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.559909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.560354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.560773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.589684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6ab92096-3de2-4896-9b91-99f874cc3ece tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044915 Oct 19 22:09:11.590224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 494/1000] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:11.599334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:11.601522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:11.607358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.607847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.608286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.608979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.609437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.610376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.639424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-28d16470-262d-4ff2-b809-4610254c916a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Oct 19 22:09:11.639966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 507/1001] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:11.768762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:11.770849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:11.776725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.777204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.777633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.778310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:11.778762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:11.779205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:11.807837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-faacc788-f77c-429a-b1af-05b015015f3e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043085 Oct 19 22:09:11.808389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 495/1002] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:12.567369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:12.569545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:12.575865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.576348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.576786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.577473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.577929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.578354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.601662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:12.603748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:12.603936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:12.608813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e855c148-27ad-4761-8cce-41f19881fd8c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Oct 19 22:09:12.609380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 508/1003] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:12.610700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.611214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.618086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.618086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.618086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.618086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.642386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3050c066-578c-445d-bc3d-45c19f806d10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Oct 19 22:09:12.642932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 496/1004] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:12.651264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:12.653393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:12.659400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.659877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.660309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.660995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.661481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.661905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.691788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3ddf07d0-9d07-49bb-9f8f-aaa969ecdf50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Oct 19 22:09:12.692338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 509/1005] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:12.820403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:12.822440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:12.828281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.828764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.829191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.829872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:12.830327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:12.830749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:12.834292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:12.859041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4d7e8756-c30a-49e6-8078-d956e547609b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042647 Oct 19 22:09:12.859581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 497/1006] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:13.628728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:13.630866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:13.637266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.637748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.638185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.638869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.639343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.639795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.654907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:13.657686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:13.664179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.664668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.665102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.665792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.666244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.666665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.669309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1d9c8157-f2e3-4857-a891-0cab2b56fcdc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Oct 19 22:09:13.669870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 510/1007] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:13.695851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6c324fa-55e9-4e0a-8109-1baf53fd1d12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Oct 19 22:09:13.696392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 498/1008] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:13.704474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:13.706647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:13.712512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.713001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.713442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.714132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.714589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.715043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.743824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7afbfbb5-a17d-4620-9b46-0453aced8a26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043735 Oct 19 22:09:13.744381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 511/1009] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:13.872191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:13.874911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:13.881580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.882052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.882478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.883195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:13.883648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:13.884066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:13.913507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-13a33664-8ef1-4133-8b60-2f9afd90faf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045288 Oct 19 22:09:13.914114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 499/1010] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:14.681645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:14.683733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:14.690643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.691158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.691593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.692281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.692735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.693161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.709319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:14.711546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:14.717797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.718284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.718719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.719439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.719895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.720322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.722642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b82a9f9a-513a-4132-81d9-40e64bd1fcc3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Oct 19 22:09:14.723248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 512/1011] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:14.748987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e26ed304-d172-4e8b-a2f9-650d083a1f32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Oct 19 22:09:14.749894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 500/1012] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:14.756408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:14.758587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:14.764318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.764794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.765225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.765904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.767029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.767452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.797062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-43c13fc6-1d76-4fc0-968e-4de16b0b3044 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Oct 19 22:09:14.798302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 513/1013] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:14.927671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:14.929848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:14.936182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.936606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.937042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.937727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:14.938182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:14.938654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:14.967769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a953e80-4d0b-4cfc-9c8f-7ee2a11363a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045979 Oct 19 22:09:14.968311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 501/1014] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:15.735613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:15.737746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:15.744074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.744548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.744975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:15.745657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.746104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.746548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:15.761611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:15.763739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:15.770538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.771049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.771485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:15.772178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.772632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.773057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:15.776472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-37e8c986-e2e9-45eb-80c3-cc74afd47fd1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Oct 19 22:09:15.777039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 514/1015] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:15.802814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7ff1e914-3329-4214-81c3-bd7fd1e8ec40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Oct 19 22:09:15.803405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 502/1016] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:15.809948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:15.812181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:15.817964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.818449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.818886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:15.819618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.820078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.820506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:15.850108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b15c3255-1e56-48e8-94f7-24cf32af6b81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Oct 19 22:09:15.850658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 515/1017] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:15.980997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:15.983141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:15.989149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.989626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.990093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:15.990780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:15.991262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:15.991687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:16.021527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-18c8e473-fdf2-4b2e-b7d8-e0309d1fe7aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044490 Oct 19 22:09:16.022072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 503/1018] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:16.789132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:16.791348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:16.798538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:16.799047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:16.799509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:16.800207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:16.800665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:16.801087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:16.815586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:16.817893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:16.825167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:16.825651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:16.826086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:16.826787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:16.827255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:16.827676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:16.830709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dd6d23e9-fdce-4fa9-966a-beec30b7ea91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Oct 19 22:09:16.831497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 516/1019] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:16.857898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6b3a0f8e-3e90-467f-b00d-22be1483e418 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Oct 19 22:09:16.858411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 504/1020] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:16.862644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:16.864847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:16.870673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:16.871208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:16.871652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:16.872340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:16.872799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:16.873227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:16.902270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f4f0dd0a-4979-403f-939e-8c367027737d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Oct 19 22:09:16.902836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 517/1021] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:17.035850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:17.037954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:17.048212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.048212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.048212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.048212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.048639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.048639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.078070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a3680589-77b6-424f-ae5b-4bdf2302839c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047499 Oct 19 22:09:17.079150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 505/1022] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:17.843688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:17.845836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:17.852214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.852692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.853123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.853806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.854260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.854682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.870442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:17.872596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:17.884224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.884418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-04d29e01-79b2-492f-8f39-0dbb0595f227 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044640 Oct 19 22:09:17.884710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.885041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 518/1023] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:17.885185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.885847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.886304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.886730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.915309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:17.916247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-046d53e9-e9d6-4c09-9708-d92b2b212bba tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049649 Oct 19 22:09:17.916804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 506/1024] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:17.917343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:17.923617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.924091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.924521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.925205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:17.925679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:17.926098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:17.955562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0cb476d0-9c6c-43cf-8be6-aa1a4db13b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Oct 19 22:09:17.956101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 519/1025] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:18.092000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:18.094037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:18.099837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.100318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.100752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:18.101435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.101884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.102306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:18.131558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1073377d-e50b-433d-812c-11cc90e49702 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043612 Oct 19 22:09:18.132098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 507/1026] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:18.897483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:18.899715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:18.906016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.906491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.907600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:18.908288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.908732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.909151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:18.928626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:18.931021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:18.937272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.937820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.938164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-94dd680b-e032-4b3b-b434-ed9915bac889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044610 Oct 19 22:09:18.938283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:18.938719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 520/1027] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:18.939014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.939684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.940109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:18.967737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:18.969162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4067f3f8-3cd5-4144-99ec-d57d6d5ad009 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Oct 19 22:09:18.970243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 508/1028] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:18.970530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:18.976357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.976835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.977266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:18.977950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:18.978400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:18.978819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:19.007570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-acec7384-1b13-4db1-86bb-bcff1913b8d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043680 Oct 19 22:09:19.008127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 521/1029] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:19.144585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:19.146691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:19.152580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:19.153060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:19.153498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:19.154174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:19.154624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:19.155070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:19.184436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e816f34c-3781-443c-b379-43b8884be980 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044456 Oct 19 22:09:19.184980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 509/1030] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:19.950644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:19.952821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:19.959877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:19.960367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:19.960802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:19.961491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:19.961947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:19.962375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:19.981593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:19.983699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:19.989918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:19.990396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:19.990822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:19.990930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9bedbd98-fc7f-4dee-973c-fb529226cd97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Oct 19 22:09:19.991482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 522/1031] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:19.991598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:19.991971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:19.992406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:20.021179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:20.024052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:20.025695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0982e02f-b717-4dcf-ab14-1e9340bb40e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047934 Oct 19 22:09:20.030443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 510/1032] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:20.030584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:20.030584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:20.030584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:20.030584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:20.030938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:20.031299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:20.061757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8bba4360-ece3-4358-8af0-5de645468e6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045882 Oct 19 22:09:20.062304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 523/1033] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:20.197059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:20.199076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:20.205498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:20.205914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:20.206340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:20.207037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:20.207485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:20.207902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:20.236332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d1d3369-6d31-434e-b138-36e857dd1680 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043380 Oct 19 22:09:20.236876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 511/1034] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:21.004114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:21.006265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:21.012660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.013140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.013571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.014261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.014714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.015169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.037942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:21.040129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:21.043465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2da2dd2a-ef53-4c7a-888b-41aefdadeef1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Oct 19 22:09:21.044196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 524/1035] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:21.046423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.046900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.047977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.048692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.049141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.049561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.074078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:21.076232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:21.079387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-050e77df-60f9-4b92-8d11-8cba827aabb4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045275 Oct 19 22:09:21.079949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 512/1036] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:21.082172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.082658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.083162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.095708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.095708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.095708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.100964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:21.114121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1cc729b8-a1a2-457c-9337-6933f316d436 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043888 Oct 19 22:09:21.118677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 525/1037] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:21.248179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:21.250282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:21.256180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.256599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.257033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.257715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:21.258166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:21.258585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:21.283009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:21.287581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-49c24405-f086-47f7-afa8-cf9eb9eecb67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043426 Oct 19 22:09:21.288123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 513/1038] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:22.056822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:22.058976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:22.066395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.066871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.067335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.068015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.068463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.068885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.092024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:22.094171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:22.098715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-16a40f43-283d-4830-aa3c-c54b73027e10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Oct 19 22:09:22.099300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 526/1039] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:22.100668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.101159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.101593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.102289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.102743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.103193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.126301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:22.128595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:22.132453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ec13eac0-6f48-40f4-9e70-2f03934590f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Oct 19 22:09:22.133100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 514/1040] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:22.134526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.135087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.135519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.136216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.136665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.137082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.166671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-98bc6500-1529-49e7-92e0-fd78e4807083 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Oct 19 22:09:22.167248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 527/1041] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:22.300499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:22.302622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:22.308772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.309189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.309619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.310292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:22.311375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:22.311801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:22.340409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ac4a1274-62fd-401c-89f3-6078e35d2c6d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044464 Oct 19 22:09:22.340950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 515/1042] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:23.111271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:23.113434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:23.119811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.120282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.120711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.121390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.121838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.122256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.145961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:23.148190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:23.152485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f10929c6-af15-4b3a-924d-3ec3e8ccfceb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045275 Oct 19 22:09:23.153100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 528/1043] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:23.154782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.155301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.155739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.156433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.157522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.157947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.178167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:23.180583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:23.186200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.186672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.187137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.187244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-946b6ad0-1cc7-4449-8ac4-fee495d99988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046707 Oct 19 22:09:23.187742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 516/1044] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:23.187909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.188362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.188781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.217522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6c188930-708a-4fde-b3cc-9043cfa3a664 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Oct 19 22:09:23.218057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 529/1045] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:23.353468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:23.355625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:23.363245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.365188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.365639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.367512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:23.367976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:23.368407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:23.397661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6d904297-d76d-43ee-9ae6-b12dd2a295db tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048148 Oct 19 22:09:23.398208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 517/1046] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:24.165663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:24.167874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:24.174747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.175271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.175709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.176396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.176853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.177278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.199419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:24.201848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:24.207828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e15b55c6-78c3-437d-a567-498b224acd23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046146 Oct 19 22:09:24.208178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.208533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 530/1047] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:24.208710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.209159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.209938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.210396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.210819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.230183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:24.232319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:24.238856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.239362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.239799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.240490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.240939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.241358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.241528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-98f45ad0-966f-443f-b095-a713901334e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046015 Oct 19 22:09:24.242080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 518/1048] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:24.269936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9cf3b134-8ead-4124-85a4-a61ad47365d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Oct 19 22:09:24.270476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 531/1049] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:24.410019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:24.412095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:24.418172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.418651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.419116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.419806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:24.420264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:24.420693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:24.450247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-67e2f579-9396-4e55-aa04-f28b789c5f58 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044446 Oct 19 22:09:24.450798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 519/1050] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:25.220600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:25.222726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:25.229042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.229519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.229952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.230636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.231115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.231537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.254238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:25.256399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:25.260190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab7fddc4-7095-4b06-8271-9a2a1a38591f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 Oct 19 22:09:25.260747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 532/1051] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:25.262732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.263249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.263693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.264398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.264856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.265288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.281256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:25.283896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:25.289630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.290163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.290598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.291316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.291763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.292180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.296254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-04d85a13-8bed-4e69-b4c6-bcb1b78aad47 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046488 Oct 19 22:09:25.296814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 520/1052] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:25.322014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-784361b2-7bf2-43f7-add6-ab33f7c44e65 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Oct 19 22:09:25.322607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 533/1053] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:25.463418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:25.465503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:25.471999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.472415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.472846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.473519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:25.474014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:25.474411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:25.502264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19a19214-a501-44c9-a710-b85642477f70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042869 Oct 19 22:09:25.502801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 521/1054] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:26.272589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:26.274744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:26.281084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.281651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.282110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.282791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.283266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.283690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.309374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:26.311435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:26.312476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6a1e9c9c-4ad5-4cc5-ac83-b054f4265437 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Oct 19 22:09:26.313751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 534/1055] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:26.319204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.319681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.320109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.320795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.321242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.321658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.337150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:26.339370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:26.345698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.346175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.346606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.347323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.347773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.348191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.352525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-65165c85-e2ce-43df-9332-bb6139439910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047316 Oct 19 22:09:26.353090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 522/1056] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:26.377415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bf554f86-f779-49d0-91c7-71c03bd4e9c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Oct 19 22:09:26.377968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 535/1057] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:26.513969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:26.516782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:26.522719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.523237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.523676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.524363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:26.524819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:26.525245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:26.553272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fcd2c219-2c16-4592-a669-b74b19c075d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043245 Oct 19 22:09:26.553810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 523/1058] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:27.325593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:27.327763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:27.334758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.335283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.335722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.336418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.336875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.337303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.364837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:27.365575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ec72fb84-fd7b-4e18-9dc5-f421d6a82066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Oct 19 22:09:27.366142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 536/1059] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:27.367283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:27.373640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.374119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.374549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.375874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.376327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.377370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.390378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:27.393159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:27.398964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.399462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.399907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.400610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.401072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.401502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.407954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ff823aa5-277d-46be-9120-5dbe058e5b8d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046968 Oct 19 22:09:27.408527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 524/1060] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:27.430567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8f3e0b07-bfc9-477e-8e8e-56172704edcd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Oct 19 22:09:27.431127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 537/1061] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:27.566458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:27.568764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:27.574557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.575066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.575495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.576216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:27.576617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:27.577034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:27.605661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7bfcae48-da2c-443f-8171-9ec9ad129b4f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043865 Oct 19 22:09:27.606202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 525/1062] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:28.378447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:28.380537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:28.382794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:28.387563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.388040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.388470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.389161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.389608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.390041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.419405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-863d64f0-4272-4b0b-8a71-9b4434d8102e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Oct 19 22:09:28.419962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 538/1063] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:28.420110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:28.422301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:28.429241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.429717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.430411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.431135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.431591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.432014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.442756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:28.444942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:28.450810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.451391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.451826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.452546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.453036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.453383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.465076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-916f385e-2c05-45a4-a2b7-2a0caaaaac13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048979 Oct 19 22:09:28.465653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 526/1064] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:28.484472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0e1e7811-e4af-400c-a33e-c8c4876911b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046141 Oct 19 22:09:28.485014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 539/1065] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:28.618672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:28.620895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:28.626763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.627289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.627729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.628420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:28.628925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:28.629306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:28.658853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2dc6bdd5-8f53-48ae-b8be-94bfead28d2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044239 Oct 19 22:09:28.659441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 527/1066] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:29.432662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:29.434739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:29.441624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.442099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.442532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.443251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.443700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.444117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.472337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-56980ff9-850d-4f28-a4f9-2c615c2ab5b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Oct 19 22:09:29.472894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 540/1067] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:29.477572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:29.479719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:29.485997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.486475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.486929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.487631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.488080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.488502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.495506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:29.497618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:29.503951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.504435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.504876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.505580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.506019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.506442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.518250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-392b42bf-91d9-4bb5-a76c-2a80e26f2a73 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Oct 19 22:09:29.518832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 528/1068] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:29.537029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-715a362e-9fa2-4ae4-a604-a3987fbfdb18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Oct 19 22:09:29.537577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 541/1069] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:29.671334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:29.674092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:29.679998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.680739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.681177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.681871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:29.682326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:29.682799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:29.712314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-514d4288-7dbd-459b-9212-37113feb80ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044989 Oct 19 22:09:29.712853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 529/1070] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:30.483828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:30.485986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:30.492521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.493001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.493463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.494150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.494604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.495050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.498682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:30.524728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e782cfda-b599-4eff-aba4-7f36f890117b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Oct 19 22:09:30.525215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 542/1071] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:30.530547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:30.533265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:30.539719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.540204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.540643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.541332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.541784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.542206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.549914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:30.552100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:30.558528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.559151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.559593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.559805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:30.560284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.560740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.561162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.572823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5ee10455-33cf-451b-aa20-d490451b22c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Oct 19 22:09:30.573384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 530/1072] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:30.590599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b5ebf1c5-019d-4c88-a842-1a3a8b82c29a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Oct 19 22:09:30.591172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 543/1073] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:30.725214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:30.727343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:30.729397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:30.733958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.734443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.734874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.735588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:30.736043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:30.736468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:30.764933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-65ee2ea3-1d84-4037-ae0b-135a53f70ea3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043694 Oct 19 22:09:30.765477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 531/1074] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:31.538106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:31.540393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:31.546842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.547359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.547788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.548495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.548980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.549403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.577895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a11de68c-3167-452a-afd8-981fce80ab9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043814 Oct 19 22:09:31.578441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 544/1075] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:31.585528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:31.587652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:31.594121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.594597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.595682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.596576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.597033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.597455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.602469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:31.604664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:31.610424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.610913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.611393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.612088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.612546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.612983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.625996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-889068f3-75f1-4fa9-9092-9d9013b3cb50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Oct 19 22:09:31.626585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 532/1076] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:31.641541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e437f3f3-3803-4e37-afed-61c6c0b4fd42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042921 Oct 19 22:09:31.642637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 545/1077] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:31.777673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:31.779811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:31.785775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.786250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.786687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.787417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:31.787911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:31.788398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:31.817817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c5062612-b97d-4ad7-9508-ff9e201df364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044028 Oct 19 22:09:31.818367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 533/1078] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:32.590752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:32.592927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:32.599478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.599963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.600403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.601099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.601557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.601982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.630491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e8995561-43a9-45ab-b446-3222c7955055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Oct 19 22:09:32.631072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 546/1079] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:32.637812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:32.639960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:32.646839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.647354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.647786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.648794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.649253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.649676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.653530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:32.655695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:32.661491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.661969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.662400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.663123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.663589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.663997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.679123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9edfff4b-3c34-4999-bb30-025c3b911dc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Oct 19 22:09:32.682018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 534/1080] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:32.693222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ba756788-d10a-4298-a51a-fe41c2a874b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Oct 19 22:09:32.693755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 547/1081] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:32.830917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:32.833057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:32.838943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.839457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.839895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.840590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:32.841091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:32.841471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:32.870241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a6c2edd6-2e44-4f3b-b210-419da04b1ade tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043952 Oct 19 22:09:32.870784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 535/1082] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:33.685762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:33.687945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:33.692217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:33.694313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:33.694562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.695072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.695500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.696187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.696631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.697047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.700539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.701014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.701444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.702132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.702578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.703016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.725875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-132e72f7-02d6-4c47-897e-ce9aae306d80 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087571 Oct 19 22:09:33.726437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 548/1083] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:33.730887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:33.733051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:33.735502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e6aff99c-95e7-4e7d-a67b-36b5b30756dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047742 Oct 19 22:09:33.736573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 536/1084] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:33.739569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.740053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.740490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.741182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.741641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.742064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.771061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bd57b384-10e4-41ba-adaa-684793411090 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Oct 19 22:09:33.771616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 549/1085] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:33.883252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:33.885371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:33.891168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.891642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.892069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.892753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:33.893202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:33.893620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:33.921522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ac2d4bf1-ccdf-4b23-960c-12f33fcae8f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042202 Oct 19 22:09:33.921991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 537/1086] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:34.738833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:34.741014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:34.747391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.747867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.747993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:34.748387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.748969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.749415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.749831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.750071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:34.756344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.756827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.757257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.757942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.758395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.758817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.778574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-68aef006-c7a0-42f7-86d8-9b17170cdf3c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Oct 19 22:09:34.779157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 550/1087] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:34.787083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:34.787083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:34.788750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ec5b719e-28cc-4e78-aae7-70f7b27a8de4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Oct 19 22:09:34.789613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 538/1088] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:34.792664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.793172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.794077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.794281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.794732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.795178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.824685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4dff383c-d08a-4a6a-b0bb-5976f407cb17 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Oct 19 22:09:34.825245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 551/1089] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:34.934527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:34.936679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:34.942518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.943031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.943466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.944149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:34.944607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:34.945029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:34.973337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d11c06b5-629e-449f-a4a1-69f4be0e03f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042983 Oct 19 22:09:34.973872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 539/1090] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:35.792091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:35.794255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:35.801350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.801602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:35.802056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.802261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:35.802973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.803440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.803732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:35.803870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:35.810228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.810709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.811182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:35.811874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.812331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.812758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:35.833441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a6f7b33f-8cd5-4ebb-8e66-d24c87329de4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Oct 19 22:09:35.834004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 552/1091] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:35.838526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:35.840674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:35.842494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5e19eb57-b3ee-4b4d-986c-04680c20f95e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Oct 19 22:09:35.847147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 540/1092] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:35.847296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.847296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.847296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:35.847898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.848356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.848784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:35.878270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-13e39d6e-6b26-4c0b-a43d-4ffeca25cf37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Oct 19 22:09:35.878814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 553/1093] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:35.986224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:35.988367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:35.994093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.994568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.995174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:35.995855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:35.996304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:35.996720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:36.025512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-debd7057-ed97-4036-90d0-ea771a54b13f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043800 Oct 19 22:09:36.026054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 541/1094] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:36.846262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:36.848416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:36.854595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:36.855086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:36.855264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:36.855691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:36.856382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:36.856697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:36.856825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:36.857229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:36.863259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:36.863737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:36.864167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:36.864853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:36.865305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:36.865728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:36.885631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a3e3c4d0-4929-48ae-a791-bffdc387c6fb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Oct 19 22:09:36.886193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 554/1095] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:36.891184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:36.893258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:36.896047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ba33339c-1e3f-4958-9e74-4f422dc712e0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Oct 19 22:09:36.896602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 542/1096] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:36.898776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:36.899297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:36.899724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:36.900409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:36.900857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:36.901274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:36.930024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-abddc9e6-044d-47f5-98be-f25b4e3ccc6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Oct 19 22:09:36.930811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 555/1097] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:37.038269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:37.040444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:37.046322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.046809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.047277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.048000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.049035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.049459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.078058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5af3ac7a-42e9-4ada-895d-f784ee5d0da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043782 Oct 19 22:09:37.078654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 543/1098] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:09:37.917273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:37.917273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:37.917273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.917273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.918201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:37.918597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.918597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.918597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.918597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.918881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:37.918881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.918881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.918881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.919239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.919239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.919655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.940543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ec404fcc-b093-418a-9046-5c7e0feccb0e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045191 Oct 19 22:09:37.941154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 556/1099] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:37.945855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:37.948040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:37.952050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69a865dd-d7e0-4d2f-9320-6e1a595c6a2b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047725 Oct 19 22:09:37.952764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 544/1100] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:37.953715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.954191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.954625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.955997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:37.956453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:37.956868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:37.985608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cccab717-9512-4648-83cf-6a60eb68fffb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Oct 19 22:09:37.986146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 557/1101] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:38.090564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:38.093101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:38.098735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:38.099249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:38.099683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:38.100363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:38.100812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:38.101235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:38.130847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-697afa1e-889d-4c1b-a431-fc955b3d0a89 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044253 Oct 19 22:09:38.133359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 545/1102] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:38.953188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:38.955927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:38.962255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:38.962733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:38.963207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:38.963901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:38.964356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:38.964781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:38.965364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:38.967508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:38.974412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:38.974896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:38.975358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:38.976054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:38.976509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:38.976935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:38.989889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:38.994620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b66188be-da4c-4587-8d34-5be0edccef79 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045410 Oct 19 22:09:38.995216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 558/1103] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:38.999849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:39.002210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:39.006880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4e728eb0-3d2d-47cc-a756-c00447d290d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Oct 19 22:09:39.007479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 546/1104] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:39.007747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:39.008229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:39.008662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:39.009362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:39.009833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:39.010259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:39.040115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0fbb60ad-0d76-4cdc-9987-8848eec58fa5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Oct 19 22:09:39.040661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 559/1105] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:39.143354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:39.145568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:39.151473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:39.151961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:39.152397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:39.153097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:39.153555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:39.153982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:39.157673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:39.183415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-235fc5f8-c92e-47d9-acc1-c259c53871e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044646 Oct 19 22:09:39.183962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 547/1106] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:40.010119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:40.012377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:40.019622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.021339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.021929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:40.022328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.022328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.022328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.022328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.022660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:40.029088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.029573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.030012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.030714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.031208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.031636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.055010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a8fe3371-df4d-470f-98a6-4ef13db8d76e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048971 Oct 19 22:09:40.057633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 560/1107] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:40.060525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:40.062636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:40.062868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-509e8a02-a7e3-46a5-ba6f-a2916672ebda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Oct 19 22:09:40.068225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 548/1108] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:40.069211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.069698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.070136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.070836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.071322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.071746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.101663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-07641dfe-ea04-4faf-970f-8e84e2908c92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Oct 19 22:09:40.109173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 561/1109] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:40.195935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:40.198099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:40.203955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.204428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.204854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.205530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:40.206004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:40.206421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:40.235397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0aaea57f-a993-4e61-bbdf-ff7cf380762c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043422 Oct 19 22:09:40.236256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 549/1110] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:41.067766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:41.069881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:41.075818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:41.076421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.076900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.077331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.078022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.078123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:41.078473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.078898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.084980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.087780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.087780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.087780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.087780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.088119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.109318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bed71dc2-e9cb-4671-9772-58418423422d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045488 Oct 19 22:09:41.109902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 562/1111] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:41.117195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-154dd81d-0507-4166-951b-70e4d7e3fde8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045268 Oct 19 22:09:41.122213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 550/1112] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:41.122346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:41.122457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:41.128327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.128798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.129225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.129905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.130349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.131157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.160384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7aa5ad9f-034d-40fc-be2b-364bd480a294 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Oct 19 22:09:41.160927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 563/1113] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:41.248365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:41.250519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:41.256553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.257032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.257463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.258147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:41.258598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:41.259045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:41.289273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-320fb280-51d9-4dd1-a107-1e788ed95495 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044878 Oct 19 22:09:41.289820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 551/1114] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:42.121987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:42.124184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:42.131305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.131783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.132211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.132901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.133336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:42.133768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.133768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.135609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:42.141995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.142432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.142857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.143567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.144011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.144427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.163557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c65035ec-6ed9-4399-b8f1-81e98a63e61f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Oct 19 22:09:42.164114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 564/1115] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:42.172198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:42.174721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4311d66c-9bad-43d6-ad2a-3f02953a4103 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Oct 19 22:09:42.175134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:42.175541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 552/1116] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:42.181040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.181514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.181942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.182629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.183110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.183531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.211966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bb1546c0-3014-4d9e-a681-77a339580f56 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 Oct 19 22:09:42.212504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 565/1117] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:42.302146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:42.304287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:42.310318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.310791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.311244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.311924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:42.312371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:42.312795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:42.340704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-af3c5842-f553-4e5d-bfdd-7c1aa138da49 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043100 Oct 19 22:09:42.341248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 553/1118] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:09:43.176173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:43.178480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:43.185580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.186057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.186486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.187100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:43.187538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.187635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.188045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.189357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:43.195634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.196113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.196551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.197234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.197709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.198131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.216891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4f8ad5ff-3797-4102-b30f-054b2352a934 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Oct 19 22:09:43.217456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 566/1119] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:43.223767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:43.225964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:43.229344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-969ab7c1-46a0-4581-80cf-9ffc0c086565 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Oct 19 22:09:43.230402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 554/1120] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:43.232032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.232519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.232960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.233660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.234118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.234545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.263479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5b355c0e-9862-4eaa-bd1b-4153c1255114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Oct 19 22:09:43.264023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 567/1121] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:43.353355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:43.355499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:43.361336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.361820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.362252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.362938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:43.363490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:43.363917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:43.392529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ed2113b-4e8e-4e66-b989-4cafed9b3da5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043220 Oct 19 22:09:43.393783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 555/1122] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:09:44.229428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:44.231692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:44.238637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.239150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.239586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.249638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.249638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.249638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.249919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:44.249919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:44.250899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.251403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.251830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.253216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.253663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.254086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.271369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-84211906-49a8-40d2-be09-32678f6dd48d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Oct 19 22:09:44.271947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 568/1123] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:44.276708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:44.278883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:44.285212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.285436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9893752-d4dd-44ce-8c7f-af877d9b35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046741 Oct 19 22:09:44.285696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.286171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 556/1124] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:44.286291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.286817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.287303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.287726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.318087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7ceb9d2d-c319-490e-b64b-d1c7f2add00a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Oct 19 22:09:44.318641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 569/1125] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:44.405916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:44.408079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:44.414423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.414896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.415363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.416043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:44.416493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:44.416914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:44.446733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3f05815d-039e-49ef-9acf-8155bfb15f0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044747 Oct 19 22:09:44.447339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 557/1126] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:45.283683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:45.285824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:45.292497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.293016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.293453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.294151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.294608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.295119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.297514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:45.299700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:45.306483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.306984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.307426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.308124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.308575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.308999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.326930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6535676-197c-4817-aeaf-98bd35e63433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047251 Oct 19 22:09:45.327550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 570/1127] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:45.332711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:45.334827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:45.340419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.340571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ac8e47f-03b4-408d-86ba-4d4ef72ba5b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046691 Oct 19 22:09:45.340901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.341047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 558/1128] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:45.341339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.342031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.342484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.342907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.371384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c1baae22-c8f8-47a9-b41b-8af83bb829ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Oct 19 22:09:45.371941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 571/1129] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:45.459935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:45.462048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:45.468116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.468595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.469021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.469702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:45.470147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:45.470593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:45.498455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4c214069-f2e5-4e1a-bfdf-c9d0b428870c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043167 Oct 19 22:09:45.499008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 559/1130] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:46.340003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:46.342099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:46.348944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.353134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.353134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.353134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.353134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.353522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.353612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:46.354813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:46.361160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.362167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.362598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.363315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.363765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.364185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.382530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9b8196b9-2e57-4d76-a6bd-e43140a7234b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Oct 19 22:09:46.383140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 572/1131] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:46.387963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:46.390088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:46.394493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7d63690e-f49d-4ba3-982e-db4abc5788e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Oct 19 22:09:46.395068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 560/1132] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:46.396713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.397203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.397640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.398339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.398794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.399246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.428346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d009d3ae-a1ef-4542-bfe4-98c3283fef63 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Oct 19 22:09:46.428893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 573/1133] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:46.511504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:46.513602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:46.520080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.520556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.520998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.521678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:46.522130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:46.522550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:46.551095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5650c757-ecf6-41f6-a52c-61a69a43b157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043523 Oct 19 22:09:46.551636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 561/1134] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:47.395876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:47.397996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:47.404638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.405124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.405568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.406271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.406604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:47.407054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.407182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.409356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:47.415739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.416222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.416656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.417350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.417803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.418224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.437757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-23f02db1-298c-4c55-8b5c-1a9152f8899e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046460 Oct 19 22:09:47.438331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 574/1135] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:47.443791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:47.445661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:47.451039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9fda3aad-0ae0-4789-94f2-c0a369844052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048240 Oct 19 22:09:47.451573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.451731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 562/1136] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:47.452068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.452504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.453209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.453830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.454258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.471373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:47.483719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-61f49262-2a5a-4df7-99a0-e4555e5ec036 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Oct 19 22:09:47.484272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 575/1137] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:47.563787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:47.566372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:47.572166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.572643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.573071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.573757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:47.574204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:47.574616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:47.599492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:47.603997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7feee094-8ae9-45aa-8c5c-20144dd620b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044162 Oct 19 22:09:47.607367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 563/1138] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:48.451270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:48.453356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:48.461006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.461569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.462001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.462690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.463209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.463631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.464710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:48.466818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:48.474197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.474676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.475140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.475824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.476300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.476716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.493786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-413b6331-5f8f-436c-952d-8b79a081bc23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Oct 19 22:09:48.501296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 576/1139] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:48.503086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:48.505195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:48.507327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9a4600bf-8e3b-4540-bdb5-8aabfe0eb0d7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046810 Oct 19 22:09:48.508083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 564/1140] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:48.511093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.511576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.512051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.512809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.513254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.513672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.543443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-866b6b61-9e18-4eab-b970-8e19db84b4aa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Oct 19 22:09:48.543991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 577/1141] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:48.617599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:48.619710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:48.625462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.625930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.626350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.627212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:48.627947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:48.628558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:48.657146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d919b5c9-4c34-4fc6-9b4b-9b484397bb23 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043398 Oct 19 22:09:48.657687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 565/1142] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:49.506156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:49.508416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:49.514859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.515377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.515815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.516513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.516973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.517400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.520349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:49.522492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:49.528727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.529196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.529626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.530309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.530768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.531207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.547460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-54a1a385-0d7d-4a2a-a014-98717b300805 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Oct 19 22:09:49.548035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 578/1143] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:49.557346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:49.559481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:49.561304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aaef7daf-c2ed-42c6-ab50-24637004ee7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Oct 19 22:09:49.562237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 566/1144] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:49.565136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.565614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.566047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.566733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.567217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.567637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.596846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c32f3b3f-a313-48d0-bf8e-f25090af84b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 Oct 19 22:09:49.597387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 579/1145] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:49.670087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:49.672238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:49.678047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.678533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.679001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.679695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:49.680178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:49.680859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:49.710207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-234be127-7dcf-4ba8-b9e1-20096c5f321f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044099 Oct 19 22:09:49.710755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 567/1146] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:50.560066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:50.562266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:50.569271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.569711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.570132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.570823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.571305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.571729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.573405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:50.575528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:50.582451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.582938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.583400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.584093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.584546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.584972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.601336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3b00a4fc-233d-486c-afc5-bcbb8fc317f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Oct 19 22:09:50.603348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 580/1147] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:50.608211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:50.610381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:50.613973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bbfa1396-7626-42c1-92b2-868c81f77979 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Oct 19 22:09:50.614546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 568/1148] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:50.616065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.616543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.616976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.617664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.618113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.618533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.647805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0175a5f1-a688-4934-b2a1-2a14557c546c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Oct 19 22:09:50.648348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 581/1149] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:50.722975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:50.725107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:50.730899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.731437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.731878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.732554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:50.733004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:50.733426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:50.762875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9c58946f-51d9-4a64-a98c-3da04befb523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044334 Oct 19 22:09:50.763453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 569/1150] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:51.614315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:51.616527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:51.623089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.623510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.623944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.624633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.625087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.625506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.625606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:51.628325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:51.634577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.635081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.635512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.636197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.636641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.637053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.655929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3067470-bbc8-421d-b6c9-7cde6d0c01db tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Oct 19 22:09:51.656660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 582/1151] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:51.662113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:51.664273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:51.667771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-be2815d7-470d-49f7-aabe-393b57830290 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Oct 19 22:09:51.668326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 570/1152] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:51.670088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.670579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.671040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.671747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.672202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.672659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.701435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-257e838e-a2cf-4b18-849b-b519e3f69379 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Oct 19 22:09:51.701983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 583/1153] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:51.775632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:51.777709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:51.784134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.784605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.785030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.785715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:51.786158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:51.786571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:51.815232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91a64e47-dea3-4bfa-afc7-7c8f482e245b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043365 Oct 19 22:09:51.815772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 571/1154] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:52.668836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:52.671007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:52.677506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.678045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.678432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.679162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.679623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.679886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:52.680578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.682284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:52.688549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.689023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.689966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.690650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.691144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.691564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.710251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-81c4ca10-7f32-4375-a40a-736fb7f26dd9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Oct 19 22:09:52.710828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 584/1155] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:52.715494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:52.717620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:52.720965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-002bd523-093c-4506-b1e6-457580a85986 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Oct 19 22:09:52.721511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 572/1156] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:52.723391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.723873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.724313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.725005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.725455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.725877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.754597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-67ec94fa-f86b-4527-9688-5905ec9be167 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042805 Oct 19 22:09:52.755162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 585/1157] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:52.827836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:52.829967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:52.836480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.836961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.837393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.838082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:52.838531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:52.838971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:52.866881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9e589dea-e539-40c9-bd03-46f4202ef5d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043042 Oct 19 22:09:52.867447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 573/1158] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:53.722926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:53.725081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:53.731558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.732030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.732462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.733147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.733269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:53.733662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.733995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.735359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:53.742203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.742682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.743160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.743883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.744343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.744770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.764704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1dc3aeb9-9fe9-491f-a0d5-daa52d16c24e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Oct 19 22:09:53.765271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 586/1159] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:53.770281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:53.772416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:53.774291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ca3fb327-763e-4f81-9767-e20e3030ff07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Oct 19 22:09:53.775144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 574/1160] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:53.777986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.778467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.778903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.779622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.780075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.780500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.810255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7bf8d1e0-fae2-46ba-8dad-b28028dd40c9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Oct 19 22:09:53.810805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 587/1161] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:53.879189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:53.881331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:53.887188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.887670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.888108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.888798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:53.889250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:53.889678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:53.919556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9205ba70-e21d-4ae0-95a5-cb4b12f21838 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044303 Oct 19 22:09:53.920108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 575/1162] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:54.777423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:54.779615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:54.782031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:54.787633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:54.788093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.788183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.794802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.794802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.794802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.795592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:54.795695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.796250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.796766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.797204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.797905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.798360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.798790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.819890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e71a4cec-ccad-4b75-b4f2-9bf67bb3732a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046417 Oct 19 22:09:54.820452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 588/1163] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:54.824910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:54.827025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:54.829821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b939d1ca-289d-48f6-8ca8-b660493798ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Oct 19 22:09:54.830892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 576/1164] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:54.833037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.833513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.833942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.834630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.835107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.835524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.864032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e45464c-9949-4a77-89ea-1db682ae4c84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042626 Oct 19 22:09:54.864570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 589/1165] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:54.932215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:54.934317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:54.940754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.941241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.941676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.942364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:54.942820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:54.943273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:54.971980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3afb53e9-3256-446f-afb9-247fce6d7f83 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043947 Oct 19 22:09:54.972515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 577/1166] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:55.832428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:55.834506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:55.841129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.841607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.841754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:55.842169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:55.842713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.843188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.843608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:55.843881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:55.850676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.851181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.851609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:55.852292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.852736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.853151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:55.873364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-63b14b73-7d2a-4a7e-a1bc-141a112ed9d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Oct 19 22:09:55.873921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 590/1167] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:55.878434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:55.880552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:55.884346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a254f3a-e077-4305-984f-51b4f77d08f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046622 Oct 19 22:09:55.884912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 578/1168] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:55.886152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.886641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.887093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:55.887779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.888224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.888640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:55.917683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a37ab88a-a143-4d61-8c93-12f2a935f3c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Oct 19 22:09:55.918224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 591/1169] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:55.984383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:55.987163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:55.992987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.993461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.993885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:55.994561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:55.995032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:55.995460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:56.023709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f29e0242-576c-47cc-88dd-d9879579accd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043248 Oct 19 22:09:56.024253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 579/1170] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:56.885811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:56.887984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:56.894882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:56.895387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:56.895817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:56.896498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:56.896944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:56.897178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:56.897573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:56.899224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:56.901093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:56.905560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:56.906044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:56.906485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:56.907264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:56.907672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:56.908758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:56.925395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:56.927183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-591037fd-30cd-4e37-a552-b1326402f170 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045261 Oct 19 22:09:56.927751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 592/1171] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:56.932583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:56.934679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:56.939104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ea53b6d5-7fce-4ba6-846d-7cae72975ee7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Oct 19 22:09:56.939882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 580/1172] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:56.941007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:56.941489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:56.941919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:56.942617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:56.943096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:56.943515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:56.973681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bd18d1ce-3289-492e-951a-0cbf60dcf675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Oct 19 22:09:56.974225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 593/1173] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:57.036576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:57.038722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:57.040886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:09:57.045662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.046139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.046574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:57.047296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.047748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.048174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:57.077256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b671cc53-b29a-4f2f-980d-b5587087c73a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045221 Oct 19 22:09:57.077809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 581/1174] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:57.939749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:57.941899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:57.948263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.948737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.949165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:57.949853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.950298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.950718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:57.951342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:57.953525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:57.959867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.960345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.960774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:57.961461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.961906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.962319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:57.980217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c8aeb45b-247a-4340-b4eb-5bbd472d2055 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Oct 19 22:09:57.980955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 594/1175] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:57.985266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:57.988033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:57.992723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-141455c7-6d1b-4604-8aa7-03e3cc0dcd3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Oct 19 22:09:57.993285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 582/1176] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:57.993584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.994058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.994489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:57.995212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:57.995657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:57.996073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:58.024290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c3b69653-9cf7-4222-99aa-abf8f9c441e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042558 Oct 19 22:09:58.024830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 595/1177] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:58.089857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:58.092035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:58.098349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:58.098818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:58.099272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:58.099956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:58.100405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:58.100829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:58.273643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c64f9713-024d-4478-8b08-5c0db10102f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.187741 Oct 19 22:09:58.274195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 583/1178] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:09:58.993106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:58.995282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:59.001617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.002083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.002508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.003783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.004243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.004658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.005461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:59.007564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:59.013825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.014300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.014726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.015521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.015969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.016383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.034153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d3db3bb5-836c-45e7-9664-11deaac3baaa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Oct 19 22:09:59.034754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 596/1179] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:59.039278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:59.041406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:59.047085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.061788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.061788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.061788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.061788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.062156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.062253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-62380a0e-7040-4571-bfad-d4be15f2933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048989 Oct 19 22:09:59.062253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 584/1180] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:09:59.079902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-90e37d92-02d9-42a0-b833-079b00912fdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Oct 19 22:09:59.080455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 597/1181] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:09:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:09:59.286454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:09:59.289023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:09:59.295021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.295506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.295937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.296633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:09:59.297088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:09:59.297543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:09:59.327237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-41866497-7ad5-46a2-87b2-ab83b4c65e8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045403 Oct 19 22:09:59.327778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 585/1182] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:09:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:00.045649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:00.047846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:00.055061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.055807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.056241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.056932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.057385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.057831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.072709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:00.076330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:00.085813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.086297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.086796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.087427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.087880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.088509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.093308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bbc80669-123a-49f0-a393-4d76906cf588 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050968 Oct 19 22:10:00.093308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 598/1183] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:00.097894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:00.100134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:00.105803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.106292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.106735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.107492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.107954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.108388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.123380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1f27f9bc-a2b9-4486-976d-2434fa49ff13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054615 Oct 19 22:10:00.123938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 586/1184] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:00.138520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bf89ba8c-04a5-4785-bc71-be7512e29f21 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Oct 19 22:10:00.139088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 599/1185] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:00.339795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:00.341878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:00.348243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.348724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.349157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.349843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:00.350294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:00.350727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:00.379294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-da2ca994-b88e-4fc9-a0a6-74efec8d6b51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043604 Oct 19 22:10:00.379832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 587/1186] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:01.105559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:01.107821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:01.115118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.115544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.115977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.116668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.117119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.117541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.136061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:01.138218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:01.144519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.145031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.145426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.146374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.146837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.147293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.147767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e23f288e-04ac-46e3-bc95-9e19123a2636 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Oct 19 22:10:01.148356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 600/1187] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:01.152944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:01.156297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:01.161362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.161855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.162297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.163020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.163484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.163913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.182574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b22a2dc5-7488-4bc1-a55b-15b5cd63b16b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050302 Oct 19 22:10:01.183162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 588/1188] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:01.193669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-63d67b55-a5fa-4bd0-9487-2b5195292859 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Oct 19 22:10:01.194219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 601/1189] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:01.393150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:01.395896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:01.401708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.402183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.402611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.403355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:01.403802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:01.404221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:01.434668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9f86c848-9ce0-41df-bd13-7dc71c7c61d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045793 Oct 19 22:10:01.435246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 589/1190] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:02.160245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:02.162360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:02.168789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.169277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.169716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.170409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.170866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.171323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.194617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:02.196774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:02.201098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5430633c-82bd-48a9-8473-a6f9a6d3f50b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Oct 19 22:10:02.201675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 602/1191] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:02.203012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.203513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.203930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.204617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.205062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.205481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.206181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:02.208375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:02.214014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.214496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.214935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.215655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.216118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.216547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.234680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dca3a770-3fcb-4561-9e5f-cb08070d3835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Oct 19 22:10:02.235267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 590/1192] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:02.245858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ed1f0288-4034-41cb-963e-3375d0ccd4ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Oct 19 22:10:02.246412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 603/1193] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:02.447405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:02.449532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:02.455340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.455814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.456290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.456965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:02.457407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:02.457822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:02.485985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-811195da-2d5c-442c-8f7b-a4d3320026b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042619 Oct 19 22:10:02.486510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 591/1194] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:03.213757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:03.215950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:03.222336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.222813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.223282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.223969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.224422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.224843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.247739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:03.249932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:03.253092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b4386a2a-11ea-4ead-bb54-504e120b2e71 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Oct 19 22:10:03.254351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 604/1195] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:03.256848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.257328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.257875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.258663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:03.258792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.259211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.259643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.260782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:03.266570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.267075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.267514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.268210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.268660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.269122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.290046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b18040ae-cb53-4823-a6dd-105e830fb9dd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046190 Oct 19 22:10:03.294860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 592/1196] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:03.299701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f4e78ced-b303-4585-a56c-4784af330739 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Oct 19 22:10:03.300291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 605/1197] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:03.498704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:03.500858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:03.507712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.507840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.508235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.508926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:03.510215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:03.510215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:03.542990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-efb206a4-da47-4130-bfee-934b52048308 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048194 Oct 19 22:10:03.543538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 593/1198] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:04.265734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:04.267921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:04.274087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.274577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.275027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.275727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.276153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.276571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.302487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:04.304869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:04.306072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1c0a1647-0aea-4621-8eba-29ca226888a8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 Oct 19 22:10:04.307163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 606/1199] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:04.311858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.312078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:04.312289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.312734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.313465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.313942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.314149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:04.314352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.320620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.322305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.322305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.322305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.322843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.323297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.344493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d401508d-4bb3-402e-931d-5833e1dbb135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Oct 19 22:10:04.345054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 594/1200] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:04.352898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3069aad8-06eb-49dc-a801-fa7ad8e137d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Oct 19 22:10:04.353473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 607/1201] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:04.556127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:04.558265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:04.564198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.564628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.565066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.565762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:04.566853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:04.567309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:04.595301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-11df4553-a0dc-4608-83c6-30487b4da48f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043308 Oct 19 22:10:04.595836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 595/1202] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:05.318708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:05.320876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:05.327203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.327677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.328109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.328789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.329265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.329682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.354521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:05.357047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:05.359146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2890a5a6-a516-4dab-9102-19c59fa4402f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Oct 19 22:10:05.359289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:05.359706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 608/1203] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:05.364255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:05.365530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.367868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.367984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:05.368068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.368068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.368068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.368310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.372155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.372574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.373009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.373694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.374143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.374557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.398433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-015bd031-25fb-4807-bc8f-251bfe09b4b6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Oct 19 22:10:05.399014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 596/1204] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:05.404944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b0fb25e0-bd2a-4dcf-9345-42c2b74a8d87 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Oct 19 22:10:05.405498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 609/1205] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:05.608466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:05.610572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:05.616699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.617181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.617622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.618316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:05.618770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:05.619217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:05.623117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:05.649194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-933e43de-bd33-43d2-a1b0-bc0abeb1c93b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044874 Oct 19 22:10:05.649751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 597/1206] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:06.371651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:06.373811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:06.380187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.380665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.381098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.381780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.382232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.382651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.411679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-312d2f88-8b16-44c8-8fd0-cecb04f7eed8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Oct 19 22:10:06.412027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:06.412507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 610/1207] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:06.414344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:06.416635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:06.418719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:06.420923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.421409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.421841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.422570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.423050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.423476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.424350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.424835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.425273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.426668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.427100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.427521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.452936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-baf6bbb3-f7ba-4218-96d4-4fff83704356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Oct 19 22:10:06.453489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 598/1208] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:06.456135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8d8049a9-12bb-49a0-a671-b3ef3003865a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043018 Oct 19 22:10:06.456690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 611/1209] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:06.662268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:06.664420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:06.670155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.670633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.671100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.671788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:06.672239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:06.672663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:06.700814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-84167035-efe0-4fb1-b414-c346d5d045d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043106 Oct 19 22:10:06.701350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 599/1210] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:07.423600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:07.426269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:07.433003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.433478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.433914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.434593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.435058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.435481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.463801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b76c0c7-4257-45fa-beb5-6fd1f2ee0459 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Oct 19 22:10:07.464350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 612/1211] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:07.465689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:07.468083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:07.468749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:07.470813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:07.474936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.475452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.475881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.476425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.476571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.476900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.477166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.477326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.477597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.478007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.478454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.478870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.507780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9e3cadfc-0827-45e4-bb7e-3241a70b93b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046254 Oct 19 22:10:07.508203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1644a5a0-14f5-4127-bfeb-567ea3f13b68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042876 Oct 19 22:10:07.508372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 600/1212] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:07.508814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 613/1213] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:07.713448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:07.715859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:07.721644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.722124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.723083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.723779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:07.724366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:07.724798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:07.754240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cc079e17-2a63-4727-96b0-04de0505a3b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044795 Oct 19 22:10:07.754781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 601/1214] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:08.476664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:08.478861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:08.485323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.485798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.486300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.487001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.487451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.487875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.516476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7c9a3ad3-062e-4856-83dc-e2f16a64bd67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Oct 19 22:10:08.517030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 614/1215] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:08.520402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:08.521525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:08.522535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:08.523614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:08.529147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.529396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.529627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.529884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.530060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.530321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.531021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.531123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.531502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.531624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.531936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.532032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.562400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-409b6a39-93a0-4320-89c2-1335255ef7d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Oct 19 22:10:08.562852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9eb63d77-e24e-4e16-bc59-d904ea8b5588 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Oct 19 22:10:08.563010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 615/1216] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:08.563433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 602/1217] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:08.766697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:08.768850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:08.775254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.776003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.776641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.777337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:08.777794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:08.778253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:08.812649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9e24fb54-ac6a-442c-ba48-2ab0a37d8f0a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049661 Oct 19 22:10:08.813074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 616/1218] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:09.528983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:09.531118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:09.537493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.537967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.538403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.539116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.539560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.539979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.569796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1c4f27b5-dc1f-42e9-baeb-ab88636045fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Oct 19 22:10:09.570349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 603/1219] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:09.573806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:09.574786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:09.575983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:09.576852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:09.582584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.582745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.583087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.583218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.583518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.583627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.584201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.584303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.584647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.584761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.585064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.585161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.614647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-711e56f0-fcc9-4a1b-b45d-daf8a508476c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043220 Oct 19 22:10:09.614855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f1f292ef-27ef-4af5-9ef8-ad43aa9f86b3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Oct 19 22:10:09.615139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 604/1220] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:09.615409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 617/1221] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:09.825401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:09.827897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:09.833665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.834142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.834569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.835294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:09.835797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:09.836215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:09.866526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-df43e939-d1f2-4fb9-953b-3ef181d6442f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045003 Oct 19 22:10:09.867041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 605/1222] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:10.582739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:10.584951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:10.591340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.591821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.592254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.592936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.593385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.593803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.624401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0d7d5738-7065-4bf8-a0c6-3b28e87a0ea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Oct 19 22:10:10.629662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 618/1223] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:10.629810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:10.630252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:10.630520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:10.633056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:10.637152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.637626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.638058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.638781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.639053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.639256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.639534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.639817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.639993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.640670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.641128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.641621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.671545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-eed43898-d2aa-4c00-a2e7-166fd42ebc14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Oct 19 22:10:10.672041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 619/1224] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:10.672253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-508bfabc-efc0-4fca-9d72-e5de7e1759dd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048378 Oct 19 22:10:10.672960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 606/1225] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:10.879445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:10.881574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:10.887425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.887905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.888339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.889026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:10.889509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:10.889929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:10.918816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7cab357-10f0-4f98-a20f-57a901eef5f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043912 Oct 19 22:10:10.919392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 620/1226] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:11.637173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:11.639347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:11.645720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.646203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.646638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.647358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.647821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.648246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.677062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2936810f-62ad-499d-a98d-d0a702411bf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Oct 19 22:10:11.677609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 607/1227] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:11.683347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:11.684589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:11.685496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:11.686735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:11.691945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.692422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.692538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.692857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.692975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.693355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.693544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.693991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.694106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.694411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.694510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.694895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.723721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e3591d97-a57d-4cee-bec6-b4f9b0e6e9eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Oct 19 22:10:11.723902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2ff69e9a-5224-43a0-966f-b405d5089509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043077 Oct 19 22:10:11.724375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 621/1228] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:11.724501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 608/1229] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:11.931616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:11.933779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:11.939738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.940219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.940652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.941354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:11.941806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:11.942232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:11.971323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7eb1ca28-9df0-444c-956d-7ce8dbd45a0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043983 Oct 19 22:10:11.971869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 622/1230] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:12.689618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:12.691861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:12.698082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.698552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.699130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:12.699813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.700257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.700676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:12.730128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-30e41a07-ccb0-4604-9723-67c73683f4c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043630 Oct 19 22:10:12.730128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 609/1231] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:12.735653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:12.735804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:12.737960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:12.738382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:12.744232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.744442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.744716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.744928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.745152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:12.745359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:12.745844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.746070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.746401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.746538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.746826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:12.747104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:12.775659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-38ab942e-cfec-4b7a-8530-623aeef34364 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Oct 19 22:10:12.775998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-515afc7f-4641-48ca-9811-10dc5c7a6249 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Oct 19 22:10:12.776209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 610/1232] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:12.776552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 623/1233] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:12.984362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:12.986485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:12.992389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.992867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.993306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:12.993998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:12.994445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:12.994865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:13.024754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b4598345-57dd-4e42-9496-8ee39fffba53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044298 Oct 19 22:10:13.025296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 611/1234] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:13.741432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:13.743611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:13.750016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:13.750494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:13.750923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:13.751619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:13.752065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:13.752483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:13.781262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d52e9d23-1a1b-4258-9d3b-447bbb941777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Oct 19 22:10:13.782921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 624/1235] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:13.792529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:13.794721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:13.798355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:13.800486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:13.800668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:13.801189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:13.801626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:13.802330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:13.802773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:13.803232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:13.825106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:13.825106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:13.825106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:13.825106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:13.825518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:13.825518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:13.825689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:13.834002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4206501-16cb-490d-ab87-229e114f09e9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Oct 19 22:10:13.834574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 625/1236] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:13.839662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0e1c298d-5b9f-4dbf-9bdc-f9b6d8f20642 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Oct 19 22:10:13.840220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 612/1237] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:14.036554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:14.038686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:14.044688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.045171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.045607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.046299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.046750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.047199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.077370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-84997cff-f843-4b04-a38e-bb186337708e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045069 Oct 19 22:10:14.077926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 626/1238] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:14.793799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:14.795983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:14.801998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.802505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.802897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.803609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.804060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.804485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.829250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:14.834356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bf507c12-2e1a-4dea-9083-149be31afe27 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Oct 19 22:10:14.834908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 613/1239] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:14.845540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:14.848347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:14.851914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:14.853991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:14.854857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.855384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.855820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.856512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.856970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.857393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.859772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.860251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.860680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.861366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:14.861886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:14.862309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:14.886438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0e9ce99d-a3b7-4672-a168-529f5c3076d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Oct 19 22:10:14.887018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 627/1240] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:14.891531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cbc4c433-8467-4f03-be3e-47317092bb6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Oct 19 22:10:14.892021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 614/1241] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:15.089752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:15.091912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:15.098461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.098936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.099394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.100091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.100539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.100961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.129712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b13eb5ad-f183-4fe1-86a4-71136b3caeac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043912 Oct 19 22:10:15.130256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 628/1242] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:15.846769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:15.849538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:15.856126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.856609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.857043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.857731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.858182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.858606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.888119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f0ef8b8-39ac-40ea-baf5-164c5cbc5613 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045366 Oct 19 22:10:15.888677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 615/1243] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:15.903016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:15.904614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:15.906723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:15.907108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:15.913361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.913989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.914436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.914630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.915094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.915388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.915671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.916084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:15.916309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.916539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:15.916934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.917041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:15.948255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8519f17b-1a66-4a06-8404-43b373e8956a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Oct 19 22:10:15.950335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-058073d9-9e21-4501-a003-8cc5c6a1441d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050023 Oct 19 22:10:15.950894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 616/1244] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:15.952917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 629/1245] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:16.144867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:16.144867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:16.150215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.150691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.151162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:16.151939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.152368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.152793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:16.181367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-876c9e0d-c61e-43f6-abd5-dab072070116 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043381 Oct 19 22:10:16.181907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 617/1246] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:16.902379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:16.904572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:16.910420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.910898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.911358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:16.912043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.912493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.912914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:16.941518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b22880f-c44e-44c2-af69-88c5e9c9c78a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Oct 19 22:10:16.942574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 630/1247] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:16.960907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:16.961890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:16.963057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:16.964049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:16.969379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.969701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.969845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.970178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.970304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:16.970606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:16.970976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.971322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:16.971430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.971772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:16.971887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:16.972191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:17.001482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8585e59f-7b84-498f-93cf-57f279d3b030 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Oct 19 22:10:17.001777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0b96f56a-275e-43c2-ae07-b1820801e229 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Oct 19 22:10:17.001961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 631/1248] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:17.003632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 618/1249] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:17.193466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:17.195630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:17.201434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:17.201899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:17.202331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:17.203030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:17.203477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:17.203902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:17.232843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8b73b5e2-0da9-4bff-afbc-e96f6231affe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043871 Oct 19 22:10:17.233388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 632/1250] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:17.955077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:17.957183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:17.963604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:17.964222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:17.964500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:17.965176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:17.965623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:17.966041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:17.996649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e40d2b26-ece3-4765-b3f5-6460c456278c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Oct 19 22:10:17.997197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 619/1251] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:18.013747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:18.014848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:18.015952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:18.016960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:18.022883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:18.023278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:18.023385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:18.023764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:18.023881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:18.024197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:18.024501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:18.024883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:18.024992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:18.025330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:18.025450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:18.025744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:18.056557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5af31aae-9698-4b32-a0cc-ac948bc28c4d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 Oct 19 22:10:18.057715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 633/1252] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:18.063190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cee3d6ef-9438-4e06-8459-a466eef184fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051673 Oct 19 22:10:18.064221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 620/1253] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:18.245401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:18.247686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:18.253659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:18.254139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:18.255105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:18.255796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:18.256243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:18.256661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:18.287449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c04b9c05-454c-44a0-b28e-6be28cd090a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045945 Oct 19 22:10:18.288007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 634/1254] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:19.009560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:19.011728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:19.018096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.018573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.019040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.019726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.020201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.020623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.051831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bef52e54-e77b-4a1b-aff6-d2352960ee56 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Oct 19 22:10:19.052173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 621/1255] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:19.069436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:19.071968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:19.076584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:19.081458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.081577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:19.081690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.081690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.081690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.081690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.082046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.084669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.085145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.085578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.086452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.086967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.087390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.112074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c014ac2d-7384-4ba6-bb71-fca93a64ec0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046492 Oct 19 22:10:19.112644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 635/1256] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:19.118540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6700ee76-60ff-48df-896c-b41d49ac98f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Oct 19 22:10:19.119239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 622/1257] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:19.300072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:19.302316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:19.308432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.308913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.309351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.310038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:19.310489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:19.310912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:19.339527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9ef6b0c-4e88-415f-88cc-0483bb6cd211 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043475 Oct 19 22:10:19.340084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 636/1258] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:20.064355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:20.066504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:20.073459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.074117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.074754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.075480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.075933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.076357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.106474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ea1d7fba-d79b-4772-95ea-258e6bf50863 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Oct 19 22:10:20.107044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 623/1259] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:20.129302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:20.131878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:20.136697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:20.138673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.138809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:20.139193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.139632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.140370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.140821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.141240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.144714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.145692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.146122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.146879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.147359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.147791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.172298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-aeaaa060-70f1-44fd-80ca-87816586196e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Oct 19 22:10:20.172865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 637/1260] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:20.180193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9455c4ff-7f9a-42c0-8ebd-2c560f3e2263 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047578 Oct 19 22:10:20.181502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 624/1261] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:20.352071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:20.354291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:20.356183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:20.361097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.361624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.365676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.365676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:20.365676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:20.365676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:20.393575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fd2a8083-8883-4fb4-94e2-3f761ebba302 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045629 Oct 19 22:10:20.394439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 638/1262] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:21.126401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:21.128567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:21.135384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.135862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.136283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.139033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.139033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.139033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.167086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e79cc24-8331-4769-b4ce-80465662fb5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Oct 19 22:10:21.167626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 625/1263] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:21.185177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:21.187394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:21.193051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:21.194373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.194866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.195260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:21.195375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.196011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.196466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.196892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.200947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.201431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.201866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.202546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.203019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.203442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.226628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ebea04dc-d67c-40a6-8e72-1ffe3477d7f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045935 Oct 19 22:10:21.227246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 639/1264] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:21.233257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-276de8ef-ab39-4975-b7a2-15bb27ded799 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Oct 19 22:10:21.233808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 626/1265] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:21.407155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:21.409252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:21.415229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.415710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.416149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.416839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:21.417294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:21.417721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:21.447530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4a439f29-f664-4631-bf99-795fb00d4f82 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 Oct 19 22:10:21.448090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 640/1266] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:22.179686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:22.182103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:22.188369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.188837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.189268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.189944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.190386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.190802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.218659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7a6b71bf-f6bc-4e4c-aa67-6f453843ad2d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Oct 19 22:10:22.219212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 627/1267] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:22.238795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:22.241006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:22.245277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:22.247312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.247465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:22.247787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.248246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.248936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.249383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.249804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.253120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.253599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.254030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.254775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.255249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.255674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.279852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-50f015fe-4e09-49b6-961d-3cfe49bc6d89 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Oct 19 22:10:22.280424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 641/1268] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:22.284518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-41368053-a6bc-42f1-9985-df0756a3f215 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Oct 19 22:10:22.285066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 628/1269] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:22.460459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:22.462608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:22.468538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.469020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.469456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.470146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:22.470601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:22.471055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:22.475256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:22.500166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bdb62025-0636-425c-b469-b339b2f38d06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044177 Oct 19 22:10:22.500728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 642/1270] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:23.231459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:23.233572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:23.239947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.240424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.240856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.241566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.242015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.242433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.270571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6c6ed5f-6658-4ad4-b9c2-cebe004b5264 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042465 Oct 19 22:10:23.271134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 629/1271] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:23.292882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:23.295061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:23.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:23.298919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:23.301664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.302150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.302589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.303311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.303770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.304200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.304575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.305053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.305480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.306423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.306870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.307311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.324443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:23.334876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1f8a58d2-0556-45ee-8604-21fbdbb67b97 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Oct 19 22:10:23.335484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 643/1272] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:23.338390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f59254fb-512b-4db1-8a01-31cc6aa036e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Oct 19 22:10:23.338945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 630/1273] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:23.512744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:23.514884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:23.520846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.521324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.521759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.522452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:23.522904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:23.523357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:23.552432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8f5f8fe5-e68d-4781-bee4-eea89d5bbef1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043643 Oct 19 22:10:23.552973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 644/1274] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:24.282092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:24.284273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:24.287372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:24.292233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.292719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.293156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.293851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.294304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.294735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.324424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-87597520-240b-45b2-8ebf-b85c201cdf93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046382 Oct 19 22:10:24.324942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 631/1275] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:24.346940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:24.349602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:24.350193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:24.352412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:24.356082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.356565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.356998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.357684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.358116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.358230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.358539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.358637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.359036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.359714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.360163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.360583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.388969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8eb5994b-fc4e-452d-80a0-4de04de30c33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Oct 19 22:10:24.389500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 645/1276] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:24.389645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-81884931-2c93-47e1-bc77-8dfe31cce6db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Oct 19 22:10:24.390162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 632/1277] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:24.565216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:24.568025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:24.573840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.574320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.574813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.575473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:24.575929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:24.576349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:24.605042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4fb9d96e-da92-442f-b3e5-369a8c032e51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043809 Oct 19 22:10:24.605588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 646/1278] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:25.336664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:25.338795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:25.345130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.345609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.346043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.346732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.347208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.347633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.376021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0eba3310-1e47-4eb6-bf3c-8440affeab0c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Oct 19 22:10:25.376580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 633/1279] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:25.401406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:25.401596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:25.403582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:25.404074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:25.409442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.409921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.410356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.410485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.410890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.411110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.411366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.411567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.411989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.412108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.412502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.412928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.441161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2626be73-1893-4de1-a09a-e418350f37ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Oct 19 22:10:25.441779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 634/1280] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:25.443053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-113469be-5909-48f1-8017-e1891bb6fbd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Oct 19 22:10:25.443619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 647/1281] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:25.617893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:25.620440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:25.632097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.632582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.633016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.633704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:25.634158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:25.634583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:25.664407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c5e7b8cf-fae0-41d2-96f4-605658db5400 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050921 Oct 19 22:10:25.664954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 635/1282] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:26.389551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:26.391739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:26.397715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.398198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.398636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.399350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.399803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.400225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.429546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62312506-445a-43f1-8968-779fca4c7066 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Oct 19 22:10:26.430105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 648/1283] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:26.454128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:26.455364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:26.456368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:26.457503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:26.462662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.463168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.463299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.463602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.463725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.464065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.464288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.464736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.464862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.465156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.465264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.465582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.494745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-46a5418c-ded6-4a96-a65d-d68b6fa36eb0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044617 Oct 19 22:10:26.495323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 636/1284] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:26.495495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-09b4386c-48bd-48ba-8a3f-e595d7e586e8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Oct 19 22:10:26.495935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 649/1285] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:26.677414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:26.679503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:26.685506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.685979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.686407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.687112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:26.687558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:26.687976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:26.716637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2111892a-84af-4169-95ad-a9875416d023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043715 Oct 19 22:10:26.717164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 637/1286] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:27.442236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:27.444406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:27.450745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.451255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.451700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.452385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.452833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.453254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.482628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f4fa53c1-92d1-40c5-ac62-2292abc622cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Oct 19 22:10:27.483204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 650/1287] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:27.506967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:27.507446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:27.509082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:27.509232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:27.514971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.515394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.515512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.515866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.515987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.516289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.516559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.516965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.517096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.517412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.517527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.517826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.547983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74582ccf-fe56-4c93-838a-07a8a02bcd4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Oct 19 22:10:27.548191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6a874358-e8d5-4f3b-892e-9d1ffb671dc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Oct 19 22:10:27.549363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 651/1288] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:27.549537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 638/1289] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:27.729368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:27.731587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:27.737838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.738314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.739333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.740090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:27.740540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:27.740962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:27.769981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1314ccbd-a3ec-42b0-93cd-2d4d3b23c10b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 Oct 19 22:10:27.770521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 652/1290] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:28.495289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:28.497567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:28.503507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.503982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.504463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.505145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.505622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.506038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.534482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9985b9ba-7f04-4b73-aa9d-f0758ba5ee6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Oct 19 22:10:28.535085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 639/1291] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:28.560379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:28.560565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:28.562469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:28.562587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:28.568833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.569180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.569290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.569655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.569771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.570088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.570388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.570770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.570867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.571243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.571365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.571662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.600989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ddcd13d4-7854-42f9-8726-602a1af3fa20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Oct 19 22:10:28.601281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fd2a5382-0c03-422e-b2d3-847ad6bcb9f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Oct 19 22:10:28.601567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 653/1292] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:28.601849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 640/1293] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:28.781554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:28.783723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:28.790310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.790798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.791269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.791963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:28.792434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:28.792853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:28.821988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-934c0d73-b5df-4fce-b3b5-706c37fcc6d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 Oct 19 22:10:28.822535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 654/1294] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:29.547454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:29.549657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:29.559205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.559844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.560283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.560993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.561450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.561878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.591333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-17cf368d-c3b4-4572-bd4f-0f0af708db64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047828 Oct 19 22:10:29.591884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 641/1295] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:29.613225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:29.613441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:29.615635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:29.617781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:29.622082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.622573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.623042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.623751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.624199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.624346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.624627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.625005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.625776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.627037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.627870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.628642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.655571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8135eb1c-c05b-4256-9aec-3d7174d39f8e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Oct 19 22:10:29.656140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 655/1296] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:29.661637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c9980b03-69f6-4423-a162-6c9c6d38f63b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052117 Oct 19 22:10:29.662186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 642/1297] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:29.833740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:29.835914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:29.841774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.842259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.842696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.843416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:29.843874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:29.844301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:29.873345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-192b69ae-b888-4d1f-ac6e-aba3d3ebcaf3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043619 Oct 19 22:10:29.873886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 656/1298] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:30.603440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:30.605721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:30.612062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.612540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.612969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.614157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.614604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.615050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.643208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-485d16d9-738d-4cc2-a258-6f2cb5cf986d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Oct 19 22:10:30.643746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 643/1299] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:30.667626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:30.669747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:30.673195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:30.675318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:30.676303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.676805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.677442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.678133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.678584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.679024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.681425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.681902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.682332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.683044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.683497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.683919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.708346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-71d2fcf9-2b06-48ae-8338-4c4e5d2fdc8b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Oct 19 22:10:30.708913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 657/1300] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:30.712821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-72a2569a-065f-4d71-a1bd-193db767587d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Oct 19 22:10:30.713367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 644/1301] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:30.886318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:30.888445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:30.894214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.894697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.895711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.896392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:30.896837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:30.897253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:30.921524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:30.926087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a14a37da-c2c9-4035-b838-136bc15494bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043830 Oct 19 22:10:30.926625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 658/1302] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:31.662152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:31.664687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:31.671255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.671740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.672175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.672875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.673325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.673749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.703661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-149fe65b-f14e-4b37-a442-8a375d3e338a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051784 Oct 19 22:10:31.704203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 645/1303] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:31.721107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:31.723942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:31.724870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:31.726965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:31.731003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.731565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.732012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.732711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.732825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.733167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.733303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.733592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.733735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.734412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.734860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.735303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.764475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0746d706-cc95-411d-81e2-cb066c4d5f3f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047664 Oct 19 22:10:31.764673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-051b9ceb-68cd-43e7-8ff9-d916eb48e86c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Oct 19 22:10:31.765230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 659/1305] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:31.765349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 646/1305] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:31.938608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:31.940701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:31.946555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.947070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.947515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.948199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:31.948653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:31.949076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:31.978426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fc72123d-ef36-440c-8c70-ce00635f1536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043849 Oct 19 22:10:31.978986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 660/1306] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:32.715839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:32.717988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:32.724847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:32.725319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:32.725748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:32.726432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:32.726879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:32.727322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:32.730928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:32.755118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-03f112df-62fa-4626-a3cc-9792a112a4cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Oct 19 22:10:32.755658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 647/1307] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:32.776544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:32.776835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:32.778652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:32.778979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:32.787290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:32.787290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:32.787545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:32.787647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:32.787737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:32.787737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:32.787884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:32.787884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:32.788047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:32.788130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:32.788351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:32.789155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:32.817502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fb5b99a4-7294-4c49-947b-99ed2e5e0de1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Oct 19 22:10:32.818064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 648/1308] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:32.818431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cb47b1cd-067e-4382-abd8-2d411355784d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045527 Oct 19 22:10:32.819003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 661/1309] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:32.990701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:32.992842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:32.998801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:32.999314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:32.999782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.000474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:33.000931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:33.001356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.030575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dcd872db-4e2d-4d9e-8037-9b2236352b9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Oct 19 22:10:33.031136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 649/1310] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:33.767181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:33.769383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:33.775613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:33.776107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:33.776502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.777260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:33.777792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:33.778193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.809206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3abf55bc-3d72-4445-90de-2fdd8a0b474b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Oct 19 22:10:33.809763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 662/1311] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:33.829515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:33.830037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:33.831653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:33.831818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:33.838355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:33.838593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:33.838872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:33.839101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:33.839334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.839529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.840030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:33.840208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:33.840483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:33.840660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:33.840907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.841075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:33.869672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7123180a-594a-4a1a-8a11-91e21e1ff603 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Oct 19 22:10:33.869972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1fcd7acc-46aa-47fb-9122-e8d4c0ef7b85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Oct 19 22:10:33.870654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 650/1312] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:33.870895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 663/1313] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:34.044038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:34.046183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:34.052554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.053033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.053466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.054158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.054612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.055070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.083922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f112d9d9-8d8d-45e9-ac2e-969ede6e91f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043726 Oct 19 22:10:34.084484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 651/1314] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:34.821621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:34.823840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:34.830475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.830979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.831422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.832148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.832669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.833014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.862073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-86fc5682-fb64-445b-a767-768ed7c29ed5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Oct 19 22:10:34.862660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 664/1315] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:34.881348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:34.881501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:34.883499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:34.883617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:34.889215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.889701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.889853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.890134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.890256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.890613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.890826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.891305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.891426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:34.891729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.891838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:34.892161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:34.920757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-490f1f9b-6521-4518-bf96-96cf7929efdd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043165 Oct 19 22:10:34.921316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 665/1316] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:34.922113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c3582ba9-2479-49d6-97ea-03a42d2ab1a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Oct 19 22:10:34.922667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 652/1317] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:35.096519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:35.099237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:35.105116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.105602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.107742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.107742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.107742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.107742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.136388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7a49c56-ed57-4a2a-bb5a-462055cc3649 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Oct 19 22:10:35.136931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 666/1318] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:35.875190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:35.877352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:35.884264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.884878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.885347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.886043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.886499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.886973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.915967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8152f6da-10c3-498f-af82-30f12b5974cc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Oct 19 22:10:35.916512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 653/1319] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:35.933283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:35.934606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:35.935462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:35.936741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:35.942227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.942710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.942915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.943167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.943422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.943849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.943949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.944298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.944528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:35.944721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.944979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:35.945395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:35.973545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0bf0d91a-a757-4cc6-8c25-8210d6b6a6d5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Oct 19 22:10:35.973771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f73bb82a-4247-4a6f-b984-837c27110a49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042880 Oct 19 22:10:35.974292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 667/1320] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:35.974410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 654/1321] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:36.148672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:36.150718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:36.156543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.157019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.157450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:36.158126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.158572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.159007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:36.188356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bfdac495-c275-49a6-9989-c83eeb18cbfe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043632 Oct 19 22:10:36.188888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 668/1322] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:36.928220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:36.930474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:36.937662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.938146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.938581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:36.939318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.939767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.940185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:36.969441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3cf9f289-fbd5-400a-84d1-99c665741fdf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Oct 19 22:10:36.969978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 655/1323] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:36.985275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:36.985664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:36.987410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:36.987783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:36.993143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.993624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.993985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.994100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:36.994444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.994730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.994871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:36.995205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.995577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:36.995699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:36.996021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:36.996436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:37.025778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-df39abcf-3607-4d15-898c-6545863896fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Oct 19 22:10:37.026226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-130da2c2-15f0-4ef3-93d7-90d699d92517 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Oct 19 22:10:37.026339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 656/1324] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:37.026779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 669/1325] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:37.200676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:37.202857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:37.209306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:37.209806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:37.210241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:37.210928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:37.211405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:37.211827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:37.240591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c55fd524-6954-484a-a20f-72132ecd11f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043839 Oct 19 22:10:37.241134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 657/1326] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:37.981366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:37.983649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:37.989634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:37.990175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:37.990549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:37.991267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:37.991722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:37.992145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:38.024179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7df5ca94-8fa8-45a2-9048-e096f9409769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046604 Oct 19 22:10:38.024714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 670/1327] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:38.037920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:38.038137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:38.040104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:38.040258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:38.045864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:38.046347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:38.046538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:38.046780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:38.047050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:38.047481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:38.047589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:38.047950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:38.048165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:38.048372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:38.048611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:38.049027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:38.077228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e7743746-d970-4b09-9b9b-d1a62746ff6e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043501 Oct 19 22:10:38.077483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b74a5bc0-f6cd-4c69-ae7d-6cc8567b8a22 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Oct 19 22:10:38.078079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 671/1328] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:38.078353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 658/1329] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:38.253537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:38.255851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:38.264547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:38.265031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:38.265463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:38.266156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:38.266617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:38.267046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:38.296559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7ea7183-1575-481b-b094-29664175c3cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046967 Oct 19 22:10:38.297109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 672/1330] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:39.037500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:39.039720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:39.051257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.051257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.051257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.051257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.051600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.051600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.078575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-713c29d2-59f7-4382-bb63-f857f4359b78 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045773 Oct 19 22:10:39.079173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 659/1331] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:39.089234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:39.089469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:39.091409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:39.091640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:39.097478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.097991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.098186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.098427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.098790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.099161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.099383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.099618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.100039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.100270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.100792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.101279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.129947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a40d098a-879c-485c-939c-ee9209bf7fc7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Oct 19 22:10:39.130697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 660/1332] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:39.131038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-47441d9b-a740-458e-9d04-20db0ad8be8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Oct 19 22:10:39.131732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 673/1333] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:39.309468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:39.311538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:39.317882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.318355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.318784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.319484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:39.319932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:39.320349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:39.349578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0a072a38-001a-4a98-b2db-178b0c39a0e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044561 Oct 19 22:10:39.350115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 661/1334] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:40.091714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:40.093898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:40.105063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.105852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.106456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.107368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.107997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.109137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.139890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e45ff5e8-1a0e-4fe9-8061-24a66bd400e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052154 Oct 19 22:10:40.140460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 674/1335] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:40.141705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:40.144153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:40.146267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:40.148398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:40.150965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.151451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.151882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.152606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.153057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.153995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.154989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.154989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.155454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.156139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.156598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.157020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.174310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:40.183574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6bd22d54-7b3d-4999-b2d0-00eb3c2be96d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Oct 19 22:10:40.184061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 662/1336] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:40.191265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-34cf6d65-4db5-45bd-928b-845a7e494b76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049767 Oct 19 22:10:40.194744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 675/1337] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:40.361868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:40.364636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:40.370533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.371049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.371494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.372213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:40.372669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:40.373094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:40.398607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:40.403427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5897c03e-c6f2-4aef-b96a-0586c33a9b4b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045502 Oct 19 22:10:40.406599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 663/1338] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:41.152619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:41.154835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:41.162646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.162943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.163397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.164095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.164546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.164969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.194985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:41.197159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:41.204196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.204690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.205124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.205822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.206282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.206708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.206936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18a26352-c3f1-4729-a408-abfa4799dc12 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058657 Oct 19 22:10:41.208030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 676/1339] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:41.212685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:41.214786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:41.220331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.221180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.221329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.221913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.222367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.223451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.236955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d38a47fb-2ead-4866-8bc0-ca8be2f4b3f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045911 Oct 19 22:10:41.237514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 664/1340] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:41.252007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3e83fd9-1647-42ef-9609-52c0e5c32811 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Oct 19 22:10:41.252556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 677/1341] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:41.416100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:41.418161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:41.424167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.424649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.425083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.425779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:41.426232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:41.426658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:41.455838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-adb5aa97-0edc-4cb2-8e69-c73f128c9140 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043810 Oct 19 22:10:41.456397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 665/1342] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:42.219660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:42.221799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:42.230137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.230622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.231084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.231781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.232234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.232653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.249244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:42.251561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:42.260098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.260883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.261317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.262056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.262702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.263147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.268965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-37e30a12-8e52-4848-b051-982163465623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053286 Oct 19 22:10:42.269555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 678/1343] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:42.277302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:42.279461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:42.285711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.286192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.286625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.287468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.287924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.288346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.293940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f7a6fcfa-d97a-444f-b137-73616ec2d6c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Oct 19 22:10:42.294555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 666/1344] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:42.318057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c955e248-6af9-41cf-92b1-65c1aaa38fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Oct 19 22:10:42.318607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 679/1345] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:42.468735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:42.470869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:42.477309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.477784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.478211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.478889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:42.479358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:42.479776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:42.507735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-81bd561f-02b1-4ffc-b6df-ab995a359d41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042926 Oct 19 22:10:42.508474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 667/1346] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:43.281416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:43.283822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:43.286729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:10:43.286980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:10:43.293401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.294244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.294366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.295037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.295495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.296156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.305674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:43.308138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:43.314557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.315351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.315832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.316595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.317047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.317470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.328857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-840916d2-c3d8-4e54-8d0e-259fae5f0025 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051484 Oct 19 22:10:43.329431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 680/1347] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:43.334675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:43.336818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:43.342460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.344285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.344285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.344285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.344578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.344923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.351345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bb4fae75-5a08-4851-85d2-7d01697ef349 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049672 Oct 19 22:10:43.352071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 668/1348] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:43.375385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a256c8f9-e778-4eb1-8768-f08f46389120 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Oct 19 22:10:43.375945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 681/1349] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:43.520769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:43.522840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:43.528630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.529105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.529533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.530215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:43.530662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:43.531118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:43.559813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a25c52a5-b93a-4f1f-bb3a-16d612dbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043633 Oct 19 22:10:43.560351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 669/1350] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:44.341971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:44.345407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:44.351747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.352229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.352658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.353371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.353819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.354271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.364049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:44.366167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:44.372424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.372909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.373369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.374058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.374506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.374926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.386904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-308c04ab-307a-4830-8988-fa6ebe50eb34 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049019 Oct 19 22:10:44.392932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 682/1351] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:44.392932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:44.394179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:44.400571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.401047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.401499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.402157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.402399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:10:44.402547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:10:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:10:44.402660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.403031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.403600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:10:44.403722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:10:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:10:44.411995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82556954-ef30-4438-8ce1-7c47e2ffe806 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052198 Oct 19 22:10:44.412562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 670/1352] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:44.432279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a0867657-829e-49e1-b643-e454b08a21d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Oct 19 22:10:44.432825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 683/1353] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:44.573700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:44.575851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:44.583434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.583852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.584283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.584998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:44.585449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:44.585876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:44.614115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1026fe4d-418a-4225-b3fa-edcbcf302f25 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045418 Oct 19 22:10:44.614687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 671/1354] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:45.401232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:45.403427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:45.411129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.411771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.412202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.412890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.413338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.413756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.424436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:45.426567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:45.433183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.433663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.434096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.434789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.435267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.435696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.444065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d2819d17-1070-4fd2-abc1-864f6b0847dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046688 Oct 19 22:10:45.444782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 684/1355] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:45.449266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:45.451389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:45.456885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.457995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.458428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.459137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.459588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.460008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.466791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fdf24106-cbc2-4d38-b103-850d961500fc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Oct 19 22:10:45.467388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 672/1356] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:45.488809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-23cb101c-7052-4468-9bc5-25646d9f81d6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Oct 19 22:10:45.489381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 685/1357] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:45.625643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:45.627787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:45.633597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.634074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.634504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.635210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:45.635665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:45.636083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:45.665809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ca94e503-0047-47d4-a0f5-162b21a9b72f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044120 Oct 19 22:10:45.666347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 673/1358] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:46.456475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:46.459377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:46.466138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.466690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.467385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.468290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.468908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.469332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.484741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:46.486871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:46.493668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.494150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.494586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.495297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.495980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.496567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.499391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f68173bc-8ca3-4c45-bee0-955411a6b5f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046815 Oct 19 22:10:46.499955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 686/1359] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:46.505217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:46.507359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:46.512983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.513462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.513898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.514585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.515163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.515592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.526842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d1a4b13b-ca1d-4e2c-8fbc-8d985851c16c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051525 Oct 19 22:10:46.527444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 674/1360] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:46.544002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-037c4d2b-c4a4-4c0b-822b-9bd809db6846 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Oct 19 22:10:46.544550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 687/1361] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:46.678186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:46.680301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:46.686216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.686691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.687158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.687833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:46.688277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:46.688692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:46.717159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-127ec1c7-cbed-45a6-8dfb-fcb9236bc6cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043479 Oct 19 22:10:46.717706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 675/1362] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:47.511591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:47.513775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:47.516092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:47.521905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.522390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.522824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.523653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.524108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.524530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.539215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:47.541372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:47.547844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.548321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.548753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.549435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.549881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.550295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.555975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-12ae73fe-4f02-4870-9fca-1e369c538659 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048271 Oct 19 22:10:47.556799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 688/1363] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:47.561264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:47.563477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:47.569538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.570012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.570439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.571153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.571601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.572019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.580203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19a53ae2-f210-4c9a-9dfd-60687d1becff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Oct 19 22:10:47.580759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 676/1364] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:47.601000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f95641be-81cf-4895-b60b-4919166e0be9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Oct 19 22:10:47.601539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 689/1365] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:47.729727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:47.731808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:47.737644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.738119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.739080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.739770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:47.740210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:47.740628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:47.769821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf11b1dd-3425-416f-8c26-ce2b9063054b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044098 Oct 19 22:10:47.770375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 677/1366] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:48.568776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:48.570930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:48.577544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.578033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.578475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.579230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.579651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.580077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.593033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:48.595190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:48.601493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.601977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.602410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.603133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.603589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.604012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.609202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-68f1faa2-9ff8-46c5-be63-17cc15c953b5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Oct 19 22:10:48.609771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 690/1367] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:48.615473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:48.617580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:48.623232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.623713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.624148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.624840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.625296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.625721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.634764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7d7dfda0-21e1-47e0-8d87-7c4d8196bee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Oct 19 22:10:48.635370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 678/1368] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:48.654913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-84ad6453-9e6c-45e6-a2ab-917682e911c5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Oct 19 22:10:48.655439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 691/1369] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:48.781417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:48.783574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:48.789544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.790025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.790455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.791169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:48.791622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:48.792042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:48.821862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bb965022-30e6-4ab4-bb6b-5ae12ecbc2c6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044370 Oct 19 22:10:48.822425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 679/1370] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:49.621577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:49.623779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:49.630712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.631223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.631659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.632341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.632791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.633218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.637658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:49.651500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:49.651500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:49.656401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.656669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.657100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.657791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.658240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.658658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.663845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bfd49a6f-dfa8-450e-9c8d-fd60958354ad tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Oct 19 22:10:49.664425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 692/1371] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:49.669014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:49.671144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:49.675734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:49.677732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.678218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.678679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.679555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.680058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.680500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.689037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-35021c6c-93ac-46e1-b37f-af7c468c90c5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Oct 19 22:10:49.689591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 680/1372] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:49.711181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-eb7a0079-d2c9-4c3f-8c73-022b61f20616 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Oct 19 22:10:49.711730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 693/1373] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:49.835006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:49.837056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:49.839149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:49.843728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.851057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.851057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.851057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:49.851057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:49.851450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:49.874519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-70b0124c-f5a2-473a-a8f3-ce2e187a42ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044197 Oct 19 22:10:49.875074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 681/1374] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:50.675988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:50.678711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:50.685296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.685776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.686204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.686886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.687360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.687776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.702850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:50.705030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:50.712273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.712831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.713335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.714104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.714628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.715157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.718242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1a05cbd5-e00d-421a-b4d6-111bded034bb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046134 Oct 19 22:10:50.719082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 694/1375] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:50.723706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:50.726417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:50.732030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.732954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.732954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.733595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.734037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.734487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.745380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e2da2a0f-ae86-4f01-966b-5922e555a212 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046321 Oct 19 22:10:50.746132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 682/1376] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:50.762899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-663bf34c-9319-4788-9b13-a3f078142997 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Oct 19 22:10:50.763487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 695/1377] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:50.887021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:50.889129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:50.895277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.895767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.896709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.897406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:50.897859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:50.898284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:50.927261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-56bdc365-6cbd-4e11-b174-c09999478108 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044306 Oct 19 22:10:50.927807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 683/1378] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:51.731227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:51.733413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:51.740117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.740380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.740814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.741515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.741968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.742392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.761466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:51.770171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:51.777134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.777620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.777775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0da4a45c-fa31-4093-bde8-a83783d7885a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050490 Oct 19 22:10:51.778052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.778355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 696/1379] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:51.779042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.779591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.780185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.783019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:51.785134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:51.791862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.792355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.792790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.793495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.793953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.794376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.815412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f83b1227-dc3a-46de-bc1a-2072f03e5a7c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059777 Oct 19 22:10:51.815969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 684/1380] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:51.824456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-19499ba1-2e37-46bc-9742-751972ad5988 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045052 Oct 19 22:10:51.825013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 697/1381] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:51.939097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:51.941213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:51.947590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.948071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.948504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.949185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:51.949632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:51.950052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:51.979107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-72c4f6e2-372d-45ad-b594-5f4ae2bcbc66 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043839 Oct 19 22:10:51.979586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 685/1382] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:10:52.790123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:52.792549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:52.799121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:52.799609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:52.800044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:52.800739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:52.801215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:52.801868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:52.828094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:52.830233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:52.832873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0d1dd534-ee5d-490f-b4b3-335f346c33e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Oct 19 22:10:52.833883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 698/1383] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:52.836922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:52.837486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:52.837925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:52.838527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:52.838676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:52.839112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:52.839539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:52.840624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:52.846194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:52.846663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:52.847122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:52.847808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:52.848255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:52.848674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:52.869841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-13753eb3-f8c9-450d-a3ef-b6a6f1689f72 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045852 Oct 19 22:10:52.870400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 686/1384] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:52.878302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cc21bc41-15a0-4268-b007-c524aaf924b5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043418 Oct 19 22:10:52.878842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 699/1385] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:52.990594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:52.992669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:52.998410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:52.998880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:52.999333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.000008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:53.000453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:53.000873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.029394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-192b49eb-29b5-42e7-bb2f-6c6a86bb6de3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042845 Oct 19 22:10:53.029937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 687/1386] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:53.845006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:53.847176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:53.853916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:53.854403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:53.854847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.855569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:53.856023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:53.856449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.881579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:53.884750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:53.889318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4531a1e2-11c1-400a-82fc-105d0c3cfd40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048112 Oct 19 22:10:53.889893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 700/1387] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:53.891509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:53.892069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:53.892510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.893326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:53.893962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:53.894583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.894720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:53.897283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:53.902934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:53.903442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:53.903879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.904577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:53.905033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:53.905460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:53.924712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d73f9847-1e73-450f-997f-2fb1f8bb8f78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 Oct 19 22:10:53.925266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 688/1388] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:53.935356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d1cad87-954e-4935-85b5-8dc67a5e3331 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Oct 19 22:10:53.935914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 701/1389] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:54.042277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:54.044427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:54.050190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.050670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.051255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.051951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.052405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.052831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.082299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-273af016-2fb2-4ed8-a3e6-f514b985da60 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044020 Oct 19 22:10:54.082864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 689/1390] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:54.901405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:54.903595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:54.909883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.910357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.910786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.911992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.912442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.912857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.941673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:54.941673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:54.944408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f7898970-86e8-4a72-8346-0cca520c3098 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046797 Oct 19 22:10:54.944976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 702/1391] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:54.945784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.946286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.947006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.947632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.948083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.948506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.949638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:54.951735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:54.957311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.957787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.958215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.958918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:54.959391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:54.959809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:54.978280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ecf115fd-365e-4aa6-b8fb-8932254d2ec3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Oct 19 22:10:54.979130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 690/1392] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:54.989366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a580b069-57fb-4a48-9b8a-137a50306cb0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 Oct 19 22:10:54.990512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 703/1393] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:55.097791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:55.099522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:55.105534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:55.106017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:55.106453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:55.107273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:55.107729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:55.108154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:55.137198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-28a1df23-79eb-4da9-a48e-c12f8a5ecb1d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045151 Oct 19 22:10:55.137750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 691/1394] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:55.956265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:55.958474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:55.965018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:55.965504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:55.965944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:55.966658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:55.967143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:55.967568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:55.990634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:55.993184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:55.997327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-19134c5a-f104-490e-9cc0-7390bd9ea219 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Oct 19 22:10:55.998048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 704/1395] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:56.000378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:56.000932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:56.001488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:56.002247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:56.002551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:56.003095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:56.003584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:56.004849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:56.011157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:56.011642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:56.012083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:56.012779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:56.013238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:56.013665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:56.033712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-470a32cb-8046-4188-adf1-c407cd560508 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047887 Oct 19 22:10:56.034266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 692/1396] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:56.042899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cc8011b7-9109-4d31-8022-be9c57a15b27 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Oct 19 22:10:56.043495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 705/1397] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:56.149693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:56.151762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:56.157581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:56.158052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:56.158482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:56.159195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:56.159681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:56.160098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:56.188768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1bf7af21-58ce-4158-8077-4074060f23e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043112 Oct 19 22:10:56.189306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 693/1398] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:57.010388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:57.013114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:57.020129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.020614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.021093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.021797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.022259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.022692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.045757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:57.048073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:57.055571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.056394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.056910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.057684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.058326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.058757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.060021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-50bbc1c7-5fc1-4c7b-a729-bb68212d0b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053426 Oct 19 22:10:57.064950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 706/1399] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:57.071267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:57.073447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:57.079226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.079712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.080152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.080863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.081319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.081747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.088684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a4188401-44de-40bb-9417-da8467eac24f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 Oct 19 22:10:57.098387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 694/1400] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:57.110942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-410c0976-bde4-42e6-8d2e-2247ffaf28e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049004 Oct 19 22:10:57.111519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 707/1401] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:57.201945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:57.204128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:57.210090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.210561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.211047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.211889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:57.212409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:57.212827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:57.242090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-79861aef-ea07-461f-aae7-1bfd3d9f1267 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044221 Oct 19 22:10:57.242637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 695/1402] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:58.072431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:58.074660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:58.081198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.081691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.082127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.082889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.086350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.086350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.109902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:58.110617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:58.113085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:58.115502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2227d61e-6cee-42c5-97e1-625139ad3a1a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046510 Oct 19 22:10:58.116156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 708/1403] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:58.120382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.121985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.121985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.122638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.123140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.123568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.123821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:58.126072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:58.131877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.132358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.132792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.133486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.133940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.134428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.153837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-52c49863-37b4-4e8b-8f09-f7df8016f99c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048573 Oct 19 22:10:58.154405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 696/1404] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:58.164294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6f4e441-b711-4789-a58b-1d713e16feb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Oct 19 22:10:58.164839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 709/1405] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:58.253663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:58.255823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:58.261645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.262130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.262547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.263256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:58.263708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:58.264128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:58.267749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:10:58.298401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-84741804-417b-403b-bed0-0463d0515754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048267 Oct 19 22:10:58.299492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 697/1406] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:10:59.132754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:59.134891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:59.141318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.141800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.142258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.144119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.144568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.147919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.167191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:59.170122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:59.177801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3dbcba0-63d1-4747-8bae-89aba61013ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Oct 19 22:10:59.178376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 710/1407] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:59.178592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.179095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.179808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.180668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.181508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.182200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.183645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:59.185753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:59.191373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.191854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.192288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.193566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.194025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.194448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.213594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1338b1c1-3f01-49cd-97ab-5182a820efff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051743 Oct 19 22:10:59.214394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 698/1408] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:10:59.223405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-766169f3-0d62-4f5e-b50a-fe454e73ff09 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043564 Oct 19 22:10:59.224143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 711/1409] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:10:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:10:59.313531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:10:59.315653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:10:59.321435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.321916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.322345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.323057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:10:59.323510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:10:59.323935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:10:59.353135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-38fdf607-ec8f-4f3f-a90e-d62fb3451890 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Oct 19 22:10:59.353681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 699/1410] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:10:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:00.189711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:00.191871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:00.198321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.198779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.199292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.199914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.200363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.200782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.226559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:00.228870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:00.235559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.236035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.236465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.237161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.237611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.238026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.245075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-07e7a178-037f-4028-8557-27c8ce92aa04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059272 Oct 19 22:11:00.245641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 712/1411] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:00.250267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:00.252441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:00.258087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.258576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.259038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.259739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.260194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.260622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.267683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5723ad86-4e34-4452-9412-3ee39a3c7a29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Oct 19 22:11:00.268234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 700/1412] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:00.289817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3ba4093b-218c-427b-b5ba-71c845979429 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Oct 19 22:11:00.290363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 713/1413] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:00.366110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:00.368254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:00.374056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.374532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.374993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.375680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:00.376123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:00.376543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:00.404726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ea4da7df-aa54-4db6-a77e-d063f7b6abf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043181 Oct 19 22:11:00.405189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 701/1414] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:01.257584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:01.259793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:01.266275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.266765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.267231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.267938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.268392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.268815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.279975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:01.282672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:01.289567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.290190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.290633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.291361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.291818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.292244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.300813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b13bd03f-81b7-48f7-b258-b138aedd3dfb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047225 Oct 19 22:11:01.301773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 714/1415] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:01.306618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:01.308752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:01.314326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.314810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.315291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.315986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.316440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.316865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.322211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ae60242e-7fca-4bd0-8f3a-605791ce8a8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Oct 19 22:11:01.322777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 702/1416] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:01.345920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bdb47174-2ed1-44ca-ba78-244e1f5f31c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043106 Oct 19 22:11:01.346475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 715/1417] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:01.417855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:01.420024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:01.425915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.426401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.426837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.427552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:01.428006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:01.428432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:01.457389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3c5e6a5b-4162-4abe-8a4f-e5cbff4b10fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043611 Oct 19 22:11:01.457946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 703/1418] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:02.313340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:02.315491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:02.321749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.322223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.322654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.323362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.323811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.324227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.342651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:02.345804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:02.353605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.354099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.354537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.355265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.355717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.356136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.362935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b478dc8-d7a7-4f99-8b9d-6a2f6831d933 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053415 Oct 19 22:11:02.363523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 716/1419] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:02.368634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:02.370743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:02.376398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.376876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.377303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.377989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.378435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.378851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.385872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2d3e321-7f37-44b4-af8c-39311717dcfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047165 Oct 19 22:11:02.386428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 704/1420] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:02.407717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8a8dfb3d-b168-40a2-81a4-066e2c9b6ac9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 Oct 19 22:11:02.408255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 717/1421] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:02.470148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:02.472344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:02.478545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.479063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.479494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.480174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:02.480623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:02.481039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:02.510155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-01c31ccc-7402-4417-b571-5f37277e1232 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043773 Oct 19 22:11:02.510623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 705/1422] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:03.375687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:03.377804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:03.383829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.384310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.384785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.385542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.385846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.386263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.398437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:03.401763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:03.408252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.408740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.409179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.409891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.410340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.410764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.417772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cc32fe36-1402-4d0c-bd1c-71433f268fbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045896 Oct 19 22:11:03.418334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 718/1423] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:03.422821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:03.424957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:03.430587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.431097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.431797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.432482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.432930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.433348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.441922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7f32b4da-4ae4-46ca-853f-2fcec3efb51a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047895 Oct 19 22:11:03.442482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 706/1424] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:03.462167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01c24cee-192e-4012-809b-6a5c013aae10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Oct 19 22:11:03.462704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 719/1425] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:03.523044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:03.525175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:03.530934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.531498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.531870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.532550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:03.532999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:03.533416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:03.562112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a6c93a37-1a32-486d-866f-6b8ddccafe9e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043562 Oct 19 22:11:03.562644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 707/1426] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:04.430380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:04.432841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:04.439257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.439744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.440185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.440883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.441340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.441788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.453635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:04.455802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:04.465763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.465763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.465763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.465763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.466116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.466116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.482557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4b7518f1-d46c-47f8-b379-9475e1fd7c76 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056568 Oct 19 22:11:04.483148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 720/1427] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:04.487722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:04.489837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:04.496043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.496180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dd40bed0-d007-4c9b-bbd0-bc74ca8365e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Oct 19 22:11:04.496530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.496740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 708/1428] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:04.500695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.500695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.500695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.500695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.527566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4e57c7c3-260a-439a-8bdd-c51d7fe87526 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 Oct 19 22:11:04.528111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 721/1429] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:04.574341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:04.576462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:04.582304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.582779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.583245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.583926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:04.584390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:04.584807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:04.613656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a5128f36-084b-40a8-a7e6-b8c378ff5514 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043219 Oct 19 22:11:04.614248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 709/1430] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:05.493921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:05.496298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:05.503525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.507209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.507696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.508433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.508901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.509017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:05.509439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.511081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:05.518555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.519068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.519510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.520215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.520680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.521107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.541986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6cb7e101-41f3-4c27-adb2-f5807d194a7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051958 Oct 19 22:11:05.542558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 722/1431] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:05.547100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:05.549239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:05.551783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9190ae3-63df-4307-b42d-56606fdfe2bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Oct 19 22:11:05.552353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 710/1432] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:05.554831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.555345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.555786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.556751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.557207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.557631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.586993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1aa54724-e2d4-4af0-95c4-7f67b77afbf4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Oct 19 22:11:05.587546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 723/1433] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:05.625957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:05.628119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:05.634441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.634924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.635384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.636076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:05.636534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:05.636964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:05.665710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-459f8728-acc0-4d0d-97b6-54a61b4c43a2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043682 Oct 19 22:11:05.666253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 711/1434] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:06.554116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:06.556743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:06.564246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:06.566485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:06.571330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.571912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.572420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.572665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.573156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.573257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.573591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.573841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.574329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.574795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.575414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.575849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.604925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b1b925ad-262c-499c-b0c8-335794d4db46 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054691 Oct 19 22:11:06.605518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 724/1435] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:06.606225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3886f83a-cfe6-40d5-9acd-55f412fdbee6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045784 Oct 19 22:11:06.610698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 712/1436] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:06.610832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:06.612431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:06.617961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.618466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.618899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.619609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.620061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.620483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.636372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:06.649170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a56fd961-41a3-4f4a-8a6c-3b0331987ce4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042710 Oct 19 22:11:06.649717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 725/1437] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:06.677711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:06.679920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:06.685988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.686463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.686896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.687602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:06.688053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:06.688474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:06.712716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:06.717251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b4f8601e-82cf-4086-ab65-26941343cb94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043468 Oct 19 22:11:06.717793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 713/1438] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:07.617849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:07.620613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:07.623474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:07.624107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:07.630443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.630932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.631393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.632101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.632561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.632989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.633673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.634350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.634850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.635636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.636156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.636632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.663303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e2398c8e-7ecf-43e4-8fce-f114663d8fba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048043 Oct 19 22:11:07.663877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 714/1439] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:07.666505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d8bddaee-4050-46f0-ad8a-f22965cb9f9b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053091 Oct 19 22:11:07.667368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 726/1440] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:07.668471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:07.670527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:07.676210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.676722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.677153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.678503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.678976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.679400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.708053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f75490d7-9cfc-47ca-bdc8-8ce2b6b11fd4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Oct 19 22:11:07.718076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 715/1441] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:07.729517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:07.731676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:07.737668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.738154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.738590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.739313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:07.739767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:07.740819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:07.769707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-aa42a54e-4384-4c8d-abc1-2a6032356471 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044060 Oct 19 22:11:07.770253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 727/1442] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:08.676253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:08.678989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:08.685936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.686108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:08.686500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.686857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.687599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.688051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.688439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:08.688550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.695078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.695569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.696004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.696705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.697155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.697577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.723755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-80a22c1f-0fe6-42bf-b5f2-2e8494dd5683 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052990 Oct 19 22:11:08.724322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 716/1443] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:08.726319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cf26abf4-dede-4bcd-8846-1f044ea0bb7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Oct 19 22:11:08.727100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 728/1444] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:08.728831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:08.730929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:08.736648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.737136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.737574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.738265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.738720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.739253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.768312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f613c1de-06d0-4c14-97d5-4cd3ca81951e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043016 Oct 19 22:11:08.768858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 717/1445] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:08.781525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:08.783699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:08.789599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.790082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.790511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.791221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:08.791672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:08.792094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:08.822587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-482f5cdf-a074-4932-a81e-98e9f26c0dae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044947 Oct 19 22:11:08.823165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 729/1446] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:09.737490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:09.738840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:09.740734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:09.741135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:09.747429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.747659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.747839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.748152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.748573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.748799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.749283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.749502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.749740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.749962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.750165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.750389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.780037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-02044c6a-9437-4d7b-87ea-8478abbde32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046377 Oct 19 22:11:09.780248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c474941d-c199-4219-9238-ee7c69bc889a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048145 Oct 19 22:11:09.780607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 730/1447] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:09.781032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 718/1448] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:09.785979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:09.788840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:09.795327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.795803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.796235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.796928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.797380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.797801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.826664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a84bd249-4f90-49bf-9e3f-4d5c940a3cff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Oct 19 22:11:09.827240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 731/1449] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:09.835535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:09.841531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:09.847520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.848007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.848456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.849148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:09.849599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:09.850019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:09.878104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4e410f0b-2b0e-438d-a8df-3ce90d33412a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047070 Oct 19 22:11:09.878595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 719/1450] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:10.794964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:10.795509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:10.795905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:10.800097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:10.804503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.804941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.805731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.806859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.807483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.808069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.810607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.811387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.812081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.812972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.813519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.814177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.838401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bb760e3e-ae78-467c-a1fe-4341fdb7e8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049475 Oct 19 22:11:10.838994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 732/1451] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:10.843478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:10.845601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:10.849902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f60b8687-cc7a-483e-811a-ad1c40074549 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060420 Oct 19 22:11:10.851883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.852365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.852799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.853485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.853932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.854347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.855582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 720/1452] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:10.884517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0a195a64-a722-43ae-9d07-2fad7072d446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Oct 19 22:11:10.885206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 733/1453] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:10.891220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:10.893436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:10.899939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.900429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.900865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.901564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:10.902019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:10.902443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:10.932757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f0a829b4-3f8c-48dc-bf8e-58b30097b9fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045601 Oct 19 22:11:10.933321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 721/1454] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:11.852731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:11.855125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:11.862036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.862528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.862752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:11.863227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.863707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.864162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.864584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.865026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:11.871962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.872505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.872933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.873601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.874057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.874479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.894432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6832e5d1-4d99-4e46-a612-67c01afa373f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Oct 19 22:11:11.895013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 734/1455] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:11.899574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:11.901671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:11.904680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8762c510-043c-4a01-a90a-f4d6a5df4ffc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Oct 19 22:11:11.905237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 722/1456] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:11.907295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.907774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.908204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.908896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.909347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.909765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.938652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c358c1e5-3ae6-4ee8-9711-0369223c5d62 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 Oct 19 22:11:11.939235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 735/1457] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:11.946298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:11.948497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:11.954217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.954703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.955181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.955882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:11.956337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:11.956763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:11.984984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-88d98c5c-b6a6-43e5-aacf-fbbfc9102096 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043212 Oct 19 22:11:11.985532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 723/1458] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:12.907136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:12.909301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:12.915965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:12.916648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:12.917225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:12.921251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:12.921251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:12.921451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:12.921878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:12.922003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:12.927214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:12.927772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:12.928283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:12.928990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:12.929481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:12.929910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:12.948419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-070e8c8a-99a8-4e93-a2fe-44632c00762f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Oct 19 22:11:12.948977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 736/1459] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:12.953430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:12.955559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:12.960813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4084c133-1367-4a2c-8717-c4ecb22fa056 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Oct 19 22:11:12.961536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 724/1460] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:12.961677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:12.962063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:12.962497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:12.963216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:12.963699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:12.964120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:12.992408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e3ac69f9-ff27-4eca-82ea-fe133a6fe0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Oct 19 22:11:12.992961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 737/1461] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:12.997489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:12.999635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:13.005450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:13.005960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:13.006396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:13.007631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:13.008087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:13.008515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:13.037446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-00fc9d1a-48b2-45ee-bad8-66155d069ce5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043950 Oct 19 22:11:13.038051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 725/1462] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:13.967621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:13.967621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:13.967621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:13.970554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:13.971078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:13.971520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:13.972231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:13.972692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:13.973119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:13.974512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:13.978973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:13.987783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:13.988339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:13.988871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:13.989659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:13.990187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:13.990636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:14.003674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b920402d-0b0e-464e-b605-ecdec7d7dcaf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Oct 19 22:11:14.004253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 738/1463] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:14.009552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:14.011700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:14.017268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:14.017755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:14.018194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:14.018918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:14.019397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:14.019828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:14.026644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37b79bf4-1835-4e9a-b161-2e2e7c35fc54 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056686 Oct 19 22:11:14.027242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 726/1464] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:14.048811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3909f904-16dc-435f-a718-8d64ef9c7b95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Oct 19 22:11:14.049532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 739/1465] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:14.049766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:14.052858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:14.059534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:14.060019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:14.060466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:14.061281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:14.061739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:14.062165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:14.091472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dc39bbe8-a9a7-4c4b-909b-0adc4c6c2fa1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045641 Oct 19 22:11:14.092026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 727/1466] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:15.016525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:15.018671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:15.025693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.026177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.026607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.027320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.027769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.028253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.039134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:15.041198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:15.047531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.048010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.048436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.049132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.049582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.050002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.058046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6686a3c0-4f94-437d-b65b-723b3433d165 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Oct 19 22:11:15.058728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 740/1467] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:15.063470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:15.065574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:15.071667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.072172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.072612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.073297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.073742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.074158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.080399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ba68e1b7-2a14-4383-8224-64daceccb15b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Oct 19 22:11:15.080965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 728/1468] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:15.104964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-749c489c-4f71-45b2-a3c2-3c1ec6df9761 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Oct 19 22:11:15.104964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 741/1469] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:15.108678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:15.110884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:15.116892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.117377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.117815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.118520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:15.119002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:15.119433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:15.149231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a4a63162-85c6-4712-b844-d48643300e80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048531 Oct 19 22:11:15.149795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 729/1470] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:16.069838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:16.071844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:16.079193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.079193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.079193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.079895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.080354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.080779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.094923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:16.095549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:16.098415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:16.109588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.109588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.111699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.112509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.112998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.113538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.126321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7b2e6a18-232c-4cfd-ae6a-5e6e88fb07d2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060415 Oct 19 22:11:16.126977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 742/1471] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:16.131735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:16.131899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:16.133929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:16.140310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.140859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.141359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.142152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.142641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.143272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.145026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0a9ce1a3-5118-4947-a269-7405e4370ba4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055072 Oct 19 22:11:16.150509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 730/1472] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:16.162334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:16.166156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:16.171603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:16.173015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.173725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.174288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.174757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d91f3421-7d08-4ba8-b626-11ebf80806a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046692 Oct 19 22:11:16.175277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:16.175394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 743/1473] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:16.176128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:16.176575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:16.207154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bbe2612c-7784-494f-942d-983b8f12673b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049348 Oct 19 22:11:16.207735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 731/1474] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:17.138712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:17.141963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:17.148517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.149343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.149667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.150366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.150813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.151261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.159669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:17.161832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:17.168220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.168700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.169130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.169865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.170276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.170696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.181185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fe04ce55-f253-47b0-887e-7e3c1f06904e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Oct 19 22:11:17.182210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 744/1475] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:17.187893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:17.190030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:17.196735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.197216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.197648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.198338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.198794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.199242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.203641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d98a89ef-e768-4a75-b49d-94cabfae456d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047798 Oct 19 22:11:17.209791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 732/1476] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:17.220023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:17.222134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:17.228095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.228581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.229013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.229557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dd474ad3-9b03-4fd8-91e2-546587c6332e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045150 Oct 19 22:11:17.229711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:17.229987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 745/1477] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:17.230218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:17.230652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:17.261145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-308f65a6-bc0f-45c4-80ae-a01364b26f3f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044968 Oct 19 22:11:17.261700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 733/1478] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:18.193529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:18.196565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:18.203195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.203686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.204124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.204826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.205285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.205709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.217479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:18.219666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:18.226201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.226684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.227150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.227837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.228287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.228731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.235735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3b06e990-26e9-465b-8045-8fe05913f9ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046036 Oct 19 22:11:18.236473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 746/1479] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:18.241596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:18.243869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:18.249657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.250174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.250632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.251345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.251801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.252225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.258705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5d870c61-044d-4aa2-bd66-d4a3fb37b1d3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045092 Oct 19 22:11:18.259288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 734/1480] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:18.273971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:18.276155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:18.281890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.282019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-61668d09-4ef7-4e3a-b44b-86c8252fe432 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Oct 19 22:11:18.282367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.282564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 747/1481] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:18.282800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.283528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:18.283978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:18.284401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:18.313143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2a2a9ccb-971e-42d8-8e22-dafdf8544225 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043483 Oct 19 22:11:18.313688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 735/1482] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:19.247145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:19.249313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:19.255826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.256315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.256755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.257451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.257905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.258339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.271192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:19.273914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:19.280178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.280733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.281241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.282000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.282528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.283068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.288594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7369a63b-ce3c-406d-b74b-3ee6e263e3a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044885 Oct 19 22:11:19.289197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 748/1483] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:19.294119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:19.296335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:19.302034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.302517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.302974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.303777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.304236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.304665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.314353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-41419ac5-b494-48ed-be68-3e774c67b3d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Oct 19 22:11:19.314922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 736/1484] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:19.325294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:19.327472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:19.333691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.334178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.335156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.335401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6d508f9c-0ad6-487d-bdcb-6ccd97fa848d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Oct 19 22:11:19.335856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:19.340177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 749/1485] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:19.340329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:19.340329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:19.365969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9e224ef-7b21-423a-a09b-86ee20e4177d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044301 Oct 19 22:11:19.366455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 737/1486] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:20.301155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:20.303976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:20.310585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.311095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.311537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.312239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.312691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.313106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.326697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:20.333648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:20.340935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.341936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.342531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.343674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.344294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.344872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.345521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-21edefe9-dd39-44f1-89fb-5ca2c099ac38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048497 Oct 19 22:11:20.346343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 750/1487] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:20.351590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:20.353693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:20.359317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.359795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.360223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.360906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.361347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.361763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.379797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cb5719e7-28f6-4085-8700-6d6530b87128 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056907 Oct 19 22:11:20.380360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 738/1488] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:20.385096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:20.387237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:20.391689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3c5919aa-a944-45c2-8cd7-03f518a7077f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Oct 19 22:11:20.392258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 751/1489] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:20.392994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.393556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.394392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.395230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:20.395692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:20.396122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:20.425255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-25cf5765-93d6-48ef-bdef-c48c8dba0b22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043915 Oct 19 22:11:20.425806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 739/1490] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:21.357760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:21.360045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:21.366970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.371061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.371061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.371061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.371061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.371676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.393417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:21.395253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:21.399576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-40a311b0-d771-44a1-a84d-3c0fb741f32c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Oct 19 22:11:21.402986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 752/1491] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:21.403135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.403135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.403303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.403880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.404339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.404774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.404922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:21.406882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:21.412485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.413625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.414085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.414776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.415253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.415665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.435490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5a8188d6-9817-4dce-9101-36874c91848e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047207 Oct 19 22:11:21.436302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 740/1492] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:21.443647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:21.445802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:21.446449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0bac454d-c366-4ecc-ad74-766d2cbae641 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045163 Oct 19 22:11:21.447026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 753/1493] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:21.451589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.452074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.452507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.453196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:21.453647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:21.454068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:21.483333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7c1732a4-c896-4965-9674-ad57dfcbaaa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043297 Oct 19 22:11:21.483898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 741/1494] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:22.412020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:22.414819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:22.421199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.421668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.422102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.422795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.423265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.423683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.448157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:22.450478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:22.453694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4401621c-bf5a-4c94-978e-bf4cfbbdb9d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Oct 19 22:11:22.454263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 754/1495] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:22.456700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.457177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.457607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.458295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.458744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.458869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:22.459320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.461411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:22.466923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.467432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.467866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.468552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.469007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.469430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.489731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a05a4a65-4ba2-4adf-bb2b-b557e6acc5b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Oct 19 22:11:22.490036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 742/1496] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:22.494583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:22.496680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:22.498548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62755b9a-acf4-4a26-b509-48b30132b7fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Oct 19 22:11:22.499285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 755/1497] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:22.502273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.502748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.503217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.503898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:22.504344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:22.504760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:22.534010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7748e47c-376a-4388-92ae-a4de5a04befd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043001 Oct 19 22:11:22.534551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 743/1498] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:23.466164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:23.468352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:23.474680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.475217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.475643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.476323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.476769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.477191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.503727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:23.504205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:23.510804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.511313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.511753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.512445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.512899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.513958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.518912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6b10341a-e374-479a-aafa-1d69a7818b1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056579 Oct 19 22:11:23.519576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 756/1499] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:23.524956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:23.527156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:23.532756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.533306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.533743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.534429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.534876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.535317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.543712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8bcfbb12-4152-4c0d-a8a6-558a109ddaf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Oct 19 22:11:23.544273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 744/1500] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:23.548782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:23.550855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:23.556454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.557218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.557634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.558322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:23.558770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:23.559225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:23.565079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f18c0cbc-8f40-4004-8afb-706ced8c5a98 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Oct 19 22:11:23.565636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 757/1501] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:23.589140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e470c4cb-6feb-468a-ae08-f96355b95f1b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043873 Oct 19 22:11:23.589704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 745/1502] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:24.530924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:24.533103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:24.540051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.540537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.540974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.541666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.542121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.542539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.557901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:24.560045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:24.566769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.567279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.567644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:24.568037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.568985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.569438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.569858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.572562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f4f60c66-407a-4e8d-b465-493a468c752f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045248 Oct 19 22:11:24.572876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 758/1503] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:24.579066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:24.579564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:24.585772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.586255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.586689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.587422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.587870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.588294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.600777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3454371f-b876-4e3d-9843-0c3078cf3184 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047581 Oct 19 22:11:24.601612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 746/1504] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:24.606118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:24.608230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:24.613792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.614269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.614697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.615404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:24.615923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:24.616339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:24.618052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f483e7ec-1c20-4909-8e8f-cde7418cf889 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Oct 19 22:11:24.618616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 759/1505] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:24.619972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:24.644670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f4854bb6-6dcc-4f2b-b019-e8f6817db023 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042094 Oct 19 22:11:24.645212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 747/1506] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:25.588020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:25.590227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:25.596762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.597277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.597670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.598351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.598800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.599244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.612558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:25.614752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:25.621648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.622128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.622744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.623646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.624579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.625349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.635666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-abdb0619-dabb-4e42-ae5f-74fd3f4af3e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052222 Oct 19 22:11:25.636235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 760/1507] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:25.640756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:25.642964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:25.649344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.649820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.650251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.650945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.651529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.651955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.656749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7f856b1e-c671-48a6-bf67-c04421dbe29c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Oct 19 22:11:25.657312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 748/1508] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:25.662099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:25.664250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:25.669737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.670362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.670800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.671521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:25.671970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:25.672392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:25.681209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-731d312a-e85a-46ab-897b-e24ed3380757 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Oct 19 22:11:25.682035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 761/1509] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:25.702159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37a3e743-4c88-4b58-8bc1-838a5bb557d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043852 Oct 19 22:11:25.702704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 749/1510] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:26.647696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:26.649797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:26.656359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.656846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.657276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.657957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.658403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.658821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.667967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:26.670077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:26.676373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.676849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.677272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.677956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.678928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.679368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.692354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0d21aa24-3c5b-4501-8cb5-c902bc33106c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048509 Oct 19 22:11:26.692912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 762/1511] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:26.698042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:26.700485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:26.706024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.706496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.706926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.707649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.708097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.708511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.709566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e290c7c6-0fe4-4183-b0dd-d8f43e969dba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Oct 19 22:11:26.710118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 750/1512] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:26.714591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:26.716702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:26.722161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.722633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.723160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.723850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:26.724295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:26.724713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:26.737688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-09f0ca28-33c0-4c88-b3b6-1f8c193c58e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Oct 19 22:11:26.738250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 763/1513] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:26.753366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5aff41e1-eaa2-4154-9342-5b3aa70b07ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042204 Oct 19 22:11:26.753850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 751/1514] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:27.705308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:27.707551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:27.726018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.726018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.726018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.726018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.726381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.726381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.726567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:27.726567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:27.731685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.732199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.732643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.733347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.733801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.734351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.750379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-386287c4-085e-4461-93f8-8938b8aeaab3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048878 Oct 19 22:11:27.756023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 764/1515] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:27.756023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:27.758172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:27.764715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.765191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.765301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2645569b-9536-4237-8c4e-3ed7c7c0b876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047343 Oct 19 22:11:27.765638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.765870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 752/1516] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:27.766317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.766764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.767243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.770593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:27.773367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:27.778936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.779444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.779877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.780573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:27.781026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:27.781452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:27.798780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d89e871b-4e17-4534-a17d-75cbecfd4509 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Oct 19 22:11:27.799590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 765/1517] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:27.811749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9fdf08ad-120a-4890-8bd0-7ef40655ac92 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044873 Oct 19 22:11:27.812295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 753/1518] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:28.766582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:28.768939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:28.779745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.779745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.779745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.779988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:28.780422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.780422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.780422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.785549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:28.790287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.791085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.791517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.794409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.795114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.795712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.816045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-54fd3201-a3b0-4baf-9cd3-cd9bacc3859b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053344 Oct 19 22:11:28.816611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 766/1519] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:28.822490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:28.824655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:28.827348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6264101e-ac02-46c6-ba04-8727bde46033 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052838 Oct 19 22:11:28.827912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 754/1520] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:28.830454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.831057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.831494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.832193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.832644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.832901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:28.833066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.835589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:28.841205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.841690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.842153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.842848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:28.843328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:28.843758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:28.862595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-00e1f8d2-930e-4a06-bd28-795e34549a37 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Oct 19 22:11:28.863184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 767/1521] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:28.872861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e8ce5fd5-a276-4a0f-b8e7-c49723c095b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043954 Oct 19 22:11:28.873400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 755/1522] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:29.829021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:29.831591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:29.839021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.839573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.840080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.840748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:29.841188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.841274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.841896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.842927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:29.849572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.850631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.851104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.851815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.852276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.852705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.878055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e212732-9b9b-460a-91d1-1011cd0079b4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052872 Oct 19 22:11:29.878890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 768/1523] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:29.883561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:29.883988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c1c4c99f-5674-47e2-a5c8-66b2756bfba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Oct 19 22:11:29.884699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 756/1524] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:29.885657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:29.889170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:29.891245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.891386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:29.891720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.892154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.892938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.893316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.893736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.897500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.897985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.898422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.899150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:29.899611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:29.900039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:29.923658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7fd3fa12-c6ec-4e85-bf33-78e778c69def tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Oct 19 22:11:29.924230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 769/1525] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:29.931398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ffe9e7aa-bc6c-4e80-a0b8-9ef2bc8c4618 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045744 Oct 19 22:11:29.932216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 757/1526] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:30.891265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:30.892634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:30.901638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:30.902058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.902058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.902058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.902300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.902612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.902841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:30.903085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.910104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.910575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.911037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.911735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.912188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.913114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.934568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d8c75616-b990-4676-a15a-fb18c2e5d151 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Oct 19 22:11:30.935155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 770/1527] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:30.940009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:30.942167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:30.944415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-129e6749-e0aa-4065-a13f-86fa4d534b86 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051387 Oct 19 22:11:30.945123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 758/1528] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:30.948187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.948679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.949124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.949493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:30.949811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.950266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.950695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.951593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:30.957015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.957487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.957915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.958593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:30.959075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:30.959552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:30.979935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-915fc215-8d61-4000-8501-de6df1c85008 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Oct 19 22:11:30.980502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 771/1529] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:30.988116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a9086c0d-15d1-4df3-af7a-d9d19af58a0e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042166 Oct 19 22:11:30.988657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 759/1530] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:31.947424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:31.949554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:31.957060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:31.957660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:31.958259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:31.958910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:31.959875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:31.960527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:31.960742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:31.961319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:31.967186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:31.967684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:31.968126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:31.968831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:31.974405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:31.974405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:31.991145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bfc024c6-03cf-4911-ad6b-0a975a75c413 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047593 Oct 19 22:11:31.991692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 772/1531] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:31.996804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:31.998895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:32.002144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2175573a-07bc-4713-b41f-342e39b252e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049308 Oct 19 22:11:32.002701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 760/1532] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:32.004380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:32.004858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:32.005283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:32.005994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:32.007051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:32.007475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:32.007887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:32.009964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:32.015567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:32.016046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:32.016483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:32.017170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:32.017622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:32.018044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:32.036627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-30fca40e-b099-4318-8e02-b3d172243c9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043306 Oct 19 22:11:32.037187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 773/1533] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:32.047223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c14173d2-bba4-4884-aad2-798d947f58b8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043460 Oct 19 22:11:32.047774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 761/1534] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:33.003449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:33.005624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:33.014446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.014940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.015073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:33.015500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.016090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.016544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.016992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.018650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:33.025511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.025994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.026443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.027215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.027669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.028086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.047878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-85c9c256-49c0-4cc0-b26a-1828f3f05794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048492 Oct 19 22:11:33.048445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 774/1535] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:33.052972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:33.055155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:33.058627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8fa00c4a-6c96-48b2-b3eb-da5491d92aeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047549 Oct 19 22:11:33.059362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 762/1536] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:33.061103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.061593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.062028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.062725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.063206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.063634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.063769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:33.065753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:33.071894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.072368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.072794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.073475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:33.073918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:33.074336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:33.080608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:33.094031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7554481b-bf80-4bf8-a771-5a073bb147a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Oct 19 22:11:33.097686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 775/1537] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:33.099116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:33.104200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2d3df637-310d-4306-86aa-2c9c773e6da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044061 Oct 19 22:11:33.104738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 763/1538] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:34.060813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:34.063596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:34.074377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.074377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.074377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.074377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.075092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.075092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.078053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:34.080798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:34.089094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.089509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.090004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.092272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.092734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.093775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.104536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f29bb55b-b4cd-4e26-8ee7-2e252f5c3644 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048000 Oct 19 22:11:34.105109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 776/1539] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:34.109646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:34.113323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:34.119498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.119982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.120412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.121113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.121563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.121990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.126671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-918e4f67-e8f3-45fd-8e3d-6ccb2f884a93 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055071 Oct 19 22:11:34.130622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 764/1540] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:34.132537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:34.134631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:34.140326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.140798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.141222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.141962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:34.142409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:34.142824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:34.152856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-027fbe27-04fc-46a4-b82d-57e8153af771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046663 Oct 19 22:11:34.157490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 777/1541] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:34.171918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ac8191c-dc9d-49aa-bb8d-5d2b9311b811 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043654 Oct 19 22:11:34.172462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 765/1542] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:35.116778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:35.130653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:35.130653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.130653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.130653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.131622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.131622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.131622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.142048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:35.144723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:35.151718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.152192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.152621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.153570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.154017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.154434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.160188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fd272ef0-f850-45a6-a8cc-999b9cca6509 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 Oct 19 22:11:35.160570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 778/1543] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:35.165853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:35.167992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:35.173771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.174253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.174781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.175512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.175966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.176385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.185933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-66ef160b-f458-4074-929f-6cd13045503d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048173 Oct 19 22:11:35.186685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 766/1544] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:35.190987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:35.193048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:35.198477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.198965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.199407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.200085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:35.200536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:35.200953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:35.205946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-48f0328e-f15a-4779-b9f8-b2ddfd45f33a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Oct 19 22:11:35.206538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 779/1545] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:35.231233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-18b5e6ae-9c3c-447c-877e-c53e7fca5216 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043490 Oct 19 22:11:35.231778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 767/1546] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:36.172778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:36.175015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:36.182766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.183285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.183721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.184414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.184867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.185382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.197968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:36.204346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:36.206596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.207136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.207567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.208281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.208763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.209178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.216672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c27f90de-ee44-4fc7-9fc7-9c1f6a4e6a84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047732 Oct 19 22:11:36.217240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 780/1547] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:36.221861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:36.224095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:36.230055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.230532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.230977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.231682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.232135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.232554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.238819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8e92f374-644b-4b5d-a0ce-53b48e696352 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Oct 19 22:11:36.239407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 768/1548] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:36.244592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:36.246685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:36.252418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.252890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.253312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.254022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:36.254469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:36.254886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:36.263394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-436e3e4d-0665-4f56-87dd-30beb5e7774c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Oct 19 22:11:36.264141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 781/1549] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:36.284304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fc6bb315-3899-49eb-8fe6-988c65bb1df6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043878 Oct 19 22:11:36.284852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 769/1550] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:37.229744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:37.232051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:37.238888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.239292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.239729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.240426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.241137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.241570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.256162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:37.258367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:37.264768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.265245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.265671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.266359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.266805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.267247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.277307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a774c838-295f-4dd0-b6c2-3157cc461d30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052115 Oct 19 22:11:37.277885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 782/1551] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:37.282419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:37.284556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:37.290928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.291493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.292099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.292631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.293087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.293514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.298304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-075d4050-9325-4ff2-aaa0-9affab760b40 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050419 Oct 19 22:11:37.299065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 770/1552] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:37.303496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:37.305608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:37.311538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.312086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.312514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.313210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:37.313657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:37.314071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:37.323294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dbfea544-1f1f-467e-883b-d8ff28506ba9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Oct 19 22:11:37.324022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 783/1553] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:37.342827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1fac3f64-50bb-45da-aa9f-36287f2f2159 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042962 Oct 19 22:11:37.343389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 771/1554] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:38.289243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:38.291591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:38.298124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.298724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.299253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.300043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.300560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.301051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.310731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:38.312888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:38.319246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.319727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.320169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.320860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.321314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.321738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.332430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e209b6af-06da-404f-8479-5ff9e6463f04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047689 Oct 19 22:11:38.332986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 784/1555] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:38.337447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:38.339551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:38.345875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.346354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.346859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.347599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.348045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.348464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.353021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-971bc979-fdf1-4d49-9f56-a5662d5a153d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Oct 19 22:11:38.353590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 772/1556] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:38.358101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:38.360216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:38.366451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.366930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.367386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.368079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:38.368527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:38.368951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:38.379552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2628a13f-ee29-4b8d-a78f-0c3bd8885218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Oct 19 22:11:38.380120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 785/1557] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:38.397437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7ae35f88-28e8-428a-91f9-4065fda59da2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042844 Oct 19 22:11:38.397995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 773/1558] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:39.345260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:39.348568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:39.355371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.355859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.356454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.357162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.357609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.358031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.367257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:39.369622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:39.376415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.376994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.377489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.378408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.378931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.379381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.387619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-56217a5c-c9be-448a-90f0-b2cac117077a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Oct 19 22:11:39.388196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 786/1559] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:39.392719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:39.394812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:39.401045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.401527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.401966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.402658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.403164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.403593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.410449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-27423dfc-de37-4e05-8c53-0d4cff54d264 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048373 Oct 19 22:11:39.411022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 774/1560] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:39.416300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:39.418379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:39.423959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.424438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.424868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.425555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:39.426006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:39.426434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:39.433134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4ae620a0-ddf6-4db7-bce8-dbeb13a84319 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Oct 19 22:11:39.433689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 787/1561] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:39.455184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d71f6764-d1ac-47fe-a0b0-a8ae31486ea0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043137 Oct 19 22:11:39.455730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 775/1562] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:40.399765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:40.401881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:40.404300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:40.409019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.409497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.410472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.411196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.411650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.412074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.429571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:40.429571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:40.432888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.433368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.433796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.434487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.434936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.435374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.445920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-41712f3e-7042-4f2e-aca9-deb55586f02a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050032 Oct 19 22:11:40.446484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 788/1563] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:40.450967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:40.453055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:40.458523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.459030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.459494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.460184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.460714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.461060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.464935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1f9361f9-3633-4b0b-beea-a4bb075ccaca tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Oct 19 22:11:40.465502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 776/1564] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:40.470074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:40.472181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:40.478083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.478564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.479010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.479702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:40.480147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:40.480567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:40.492867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f47b60cc-6105-4bcc-8c16-b23698687af6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Oct 19 22:11:40.493435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 789/1565] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:40.509889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d6f95d20-316a-4c17-99de-619790441623 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043402 Oct 19 22:11:40.510427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 777/1566] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:41.457819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:41.460762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:41.467170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.467654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.468098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.468932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.469392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.469816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.477694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:41.480097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:41.486613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.487126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.487588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.488278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.488722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.489370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.500571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-71dc6cf9-ce23-4cc4-b032-4a987a71871d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Oct 19 22:11:41.501379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 790/1567] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:41.506731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:41.508949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:41.514975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.515473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.515905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.516615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.517109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.517530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.523144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-524e8297-6b98-4dde-b7ec-b6fa0a6d46bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049695 Oct 19 22:11:41.523732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 778/1568] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:41.528320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:41.530434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:41.536133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.536610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.537041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.537821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:41.538273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:41.538695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:41.547589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1533b782-2c0a-4e81-8de8-2bb866c25d66 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Oct 19 22:11:41.548149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 791/1569] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:41.569218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2d790682-0a38-4a70-bc76-c6e69f095127 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043925 Oct 19 22:11:41.569777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 779/1570] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:42.513136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:42.515293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:42.522121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.522598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.523049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.523730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.524174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.524591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.528280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:42.538309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:42.547474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:42.547474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.547933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.548307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.548888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.549335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.549750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.559302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c89416e0-c215-4357-aa0d-45656492ef49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050082 Oct 19 22:11:42.559903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 792/1571] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:42.564620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:42.566722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:42.567190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:42.573871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.574356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.574790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.575537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.576018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.576438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.580688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9889940d-1f49-4aeb-bb1c-b7031be2110e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048370 Oct 19 22:11:42.588159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 780/1572] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:42.588159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:42.588521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:42.590195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:42.594806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.595330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.595768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.596464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:42.596924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:42.597357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:42.607536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-969fe0b5-1f10-4e60-bfd5-05e7b938521d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Oct 19 22:11:42.608281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 793/1573] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:42.627666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2a1e54d4-d139-485b-b0bc-5c8ff7f80e32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045375 Oct 19 22:11:42.628222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 781/1574] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:43.571337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:43.573467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:43.580072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.580558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.580998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.581688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.582143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.582564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.596190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:43.599251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:43.606123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.606612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.607077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.607794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.608244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.608668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.613386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-104babfd-0a11-4370-892b-c5607f2bfa49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Oct 19 22:11:43.613950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 794/1575] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:43.620326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:43.622411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:43.628035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.628512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.628944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.629629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.630074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.630490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.639583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e066c2cc-1c67-47b9-a60d-0cf13a7d0d7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 Oct 19 22:11:43.642979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 782/1576] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:43.648018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:43.650083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:43.655807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.656292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.656731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.657433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:43.657890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:43.658319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:43.659856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7e5dcfc6-718d-4482-9571-a98431ec7f0d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Oct 19 22:11:43.660583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 795/1577] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:43.687964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6adfa169-9610-4d31-a096-aec30e55ba0c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043846 Oct 19 22:11:43.688514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 783/1578] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:44.626253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:44.628455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:44.635390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.636086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.636526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.637223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.637677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.638101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.651452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:44.653487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:44.659896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.660375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.660810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.661502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.661956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.662377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.672498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f6546c72-5114-499f-aa91-6f18b59a42e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050440 Oct 19 22:11:44.673065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 796/1579] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:44.677647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:44.680292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:44.686145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.686628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.687100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.687801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.688259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.688686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.692356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d483522a-957d-468b-8c8c-a30232a2b80d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Oct 19 22:11:44.692913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 784/1580] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:44.702692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:44.704838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:44.710445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.710914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.711371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.712058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:44.712501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:44.712917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:44.718341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-998ee24f-bdc3-4ab4-b159-396e21f48963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Oct 19 22:11:44.718903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 797/1581] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:44.741776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e7abfd91-79ec-45fa-8630-3fd3ce45dbc5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043014 Oct 19 22:11:44.742316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 785/1582] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:45.685366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:45.687565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:45.694564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.695081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.695525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.696223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.696680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.697106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.704800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:45.706920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:45.713148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.713633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.714071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.714764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.715275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.715730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.736151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-410bfc8a-1e77-44a6-ae35-0f4ca4b7f2f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054878 Oct 19 22:11:45.736710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 798/1583] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:45.742063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:45.742548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:45.745651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4bafed05-7b69-4e75-936c-36c0b33a05b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Oct 19 22:11:45.746214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 786/1584] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:45.749635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.750125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.750553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.750722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:45.751269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.751722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.752134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.752880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:45.759198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.759682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.760119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.760814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.761281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.761695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.797051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed6e4d0f-69d5-4c87-9031-3f4ef4253f87 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049803 Oct 19 22:11:45.797628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 787/1585] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:45.802313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:45.805023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:45.810946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.811464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.811905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.812599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:45.813056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:45.813483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:45.833623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lazy-loading 'services' on Instance uuid c3772e1d-c468-46b9-95cf-d21bb0e427b6 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:11:45.842294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4061bd88-a6ac-40e7-a1c5-83ca8f8ed8c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043653 Oct 19 22:11:45.842843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 788/1586] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:46.023387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b31be876-3cf8-4935-8ff9-8d9acea00465 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6/os-volume_attachments/10cd57fb-063a-4448-b9a2-b6be724233c5" status: 202 len: 0 microversion: 2.1 time: 0.285430 Oct 19 22:11:46.023981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 799/1587] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:11:45 2022] DELETE /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6/os-volume_attachments/10cd57fb-063a-4448-b9a2-b6be724233c5 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:11:46.749626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:46.751803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:46.758792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.759136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:46.759553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.759746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.760430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.760886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.761306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.761435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:46.767353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.767832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.768263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.768953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.769403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.769824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.794532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f0b5ee49-3f95-4417-aacb-ebbccec44777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048972 Oct 19 22:11:46.795211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 789/1588] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:46.800493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5a6f6c01-e5f7-4331-8ec8-39ec448b9df2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Oct 19 22:11:46.801056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 800/1589] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:46.809474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:46.811641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:46.817348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.817820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.818246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.819457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.819908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.820324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.848978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7f0f6466-29c6-4111-92d3-b69b070914c2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Oct 19 22:11:46.849519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 790/1590] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:46.854946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:46.857084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:46.862873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.863379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.863813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.864501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:46.864951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:46.865372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:46.894662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4b76a592-f006-4cb5-86d0-ef89c2b942b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043641 Oct 19 22:11:46.895240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 801/1591] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:47.807277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:47.809572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:47.813199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:47.816209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:47.818850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.818850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.818850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.818850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.819327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.819327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.822909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.823412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.823842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.824531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.825000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.825606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.847703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b7b7b21-1fad-4e6f-be1d-d1e387f34798 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Oct 19 22:11:47.848253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 791/1592] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:47.856078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ca737ecd-f211-45f1-8152-42c4af4ef334 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046969 Oct 19 22:11:47.856629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 802/1593] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:47.861320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:47.863476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:47.869110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.869581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.870008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.870686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.871164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.871584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.899859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cc7cb8ac-517b-41f5-b016-fb9aa649d5c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042513 Oct 19 22:11:47.900339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 792/1594] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:47.907056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:47.909170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:47.915693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.916172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.916597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.917275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:47.917722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:47.918138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:47.946417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e23e5db4-ab2b-4cd9-a42c-6d8a66f4fff2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043285 Oct 19 22:11:47.946959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 803/1595] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:48.861084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:48.863229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:48.871147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.871278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.871673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.872364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.872803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.873224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.873397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:48.875600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:48.882119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.882607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.883076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.883778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.884232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.884658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.903136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e4f78c62-adab-4c96-ba91-cf11d4da62dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Oct 19 22:11:48.903699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 793/1596] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:48.913190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:48.915339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:48.915499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f8843747-5743-4764-a0a2-b7d2f4f33159 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051210 Oct 19 22:11:48.916030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 804/1597] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:48.929455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.929455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.929455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.929455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.929855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.929855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.952955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3f8cc188-3a7a-4e42-9ee8-9602cfef0993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Oct 19 22:11:48.953697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 794/1598] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:48.958858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:48.961052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:48.966865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.967372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.967802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.968481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:48.968926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:48.969345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:48.998602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-403ebf17-d316-482a-b237-c16ca98ad296 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043676 Oct 19 22:11:48.999172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 805/1599] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:49.915586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:49.917773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:49.924137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:49.924615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:49.925048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:49.925735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:49.926185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:49.926607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:49.935020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:49.937159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:49.944567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:49.945045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:49.945477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:49.946165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:49.946620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:49.947064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:49.956659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b4028e0d-2f89-48c3-a031-280493a9792e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Oct 19 22:11:49.957222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 795/1600] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:49.964993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:49.967123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:49.972828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:49.973306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:49.973738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:49.974423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:49.974968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:49.975389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:49.976160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0fd5c88c-8ef4-4d6b-9eb4-c5d94e729385 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045575 Oct 19 22:11:49.976730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 806/1601] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:50.008750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9accf2b2-57f2-44ba-bd62-4336f3134e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Oct 19 22:11:50.009305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 796/1602] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:50.011655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:50.013811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:50.019718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:50.020204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:50.020925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:50.021340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:50.022037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:50.022267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:50.051000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1bdac85e-ce96-4b19-a870-ed37f7e6a7b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043329 Oct 19 22:11:50.051557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 807/1603] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:50.969127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:50.971352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:50.978551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:50.979053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:50.979485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:50.980170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:50.980623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:50.981041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:50.984977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:50.989460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:50.992193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:50.998052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:51.002009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:51.002009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:51.002009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:51.002009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:51.002440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:51.004342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:51.011309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bd02f4ca-a781-44fc-8666-11cdb0808034 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046022 Oct 19 22:11:51.011877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 797/1604] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:51.020887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:51.023768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:51.030084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:51.030566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:51.031030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:51.031473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7ca341e-3dca-42c1-a5e0-47486092b80c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046877 Oct 19 22:11:51.031737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:51.032039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 808/1605] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:51.032188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:51.032710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:51.061743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-53ec63cd-2fdb-4d14-b047-ee8527856b12 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Oct 19 22:11:51.062389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 798/1606] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:51.064297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:51.066484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:51.073302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:51.073783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:51.074220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:51.074912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:51.075399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:51.075825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:51.104974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6dd2ff68-e05f-433b-9c7c-a96e5c1f968d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044970 Oct 19 22:11:51.105526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 809/1607] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:52.023803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:52.027467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:52.033903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.034386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.034823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.035551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.036076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.036503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.045654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:52.047979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:52.055444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.055925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.056386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.057339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.057785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.058203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.066306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d1b9707b-078c-4134-9c9b-e0ce1fa1c695 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 Oct 19 22:11:52.066876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 799/1608] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:52.074826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:52.076959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:52.082786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.083289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.083725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.085012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.085467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.085894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.088874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-10c8b871-aff6-4618-8fb4-85127e95054d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048488 Oct 19 22:11:52.090387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 810/1609] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:52.114389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7667b60b-7bdd-4f2a-99a6-ac2ac2153fb8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Oct 19 22:11:52.114936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 800/1610] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:52.118020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:52.120168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:52.125934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.126405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.126831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.127538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:52.127986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:52.128403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:52.157223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f2c3e11-41aa-458d-979b-c9ca50046cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043674 Oct 19 22:11:52.157767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 811/1611] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:53.080858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:53.083056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:53.089576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.090047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.090479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.099203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.099203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.099203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.102914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:53.105908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:53.112580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.113139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.113780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.114548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.115107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.115664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.121706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cd20e3d5-306d-4552-8fc4-b9889ef8942a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044835 Oct 19 22:11:53.122338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 801/1612] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:53.126838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:53.129004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:53.134766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.135272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.135746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.136420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.136871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.137289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.147548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9325a157-1996-4bbf-8913-dea7c5a6b7ce tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049311 Oct 19 22:11:53.148127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 812/1613] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:53.167769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-20e7fe60-a6ff-4786-a51f-807e91fb50f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Oct 19 22:11:53.168427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 802/1614] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:53.169623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:53.171774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:53.177639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.178153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.178587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.179299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:53.179752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:53.180179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:53.208582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bd9c8356-07d8-4586-8d44-d6ba6ad110c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042943 Oct 19 22:11:53.209641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 813/1615] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:54.134190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:54.136379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:54.142643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.143156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.143594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.144282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.144731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.145150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.160951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:54.163302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:54.169884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.170707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.170999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.171647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.172108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.172534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.175930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a9ec9e8a-a302-4d3f-9c93-ddd39a1bfb35 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046157 Oct 19 22:11:54.176568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 803/1616] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:54.181068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:54.183447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:54.189090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.189576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.190011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.190699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.191173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.191598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.203633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-865f9c90-9d0f-4378-9502-6beee83c22fa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047662 Oct 19 22:11:54.205203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 814/1617] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:54.221504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:54.221694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-234753f6-1690-4e11-97a2-d53387874363 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Oct 19 22:11:54.222168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 804/1618] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:54.223594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:54.229789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.230370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.230865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.231686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:54.232137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:54.232608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:54.261429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-50a26859-a057-41ee-a519-d663b69e4c5a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043836 Oct 19 22:11:54.261973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 815/1619] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:55.188714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:55.190871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:55.197336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.197815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.198250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.198935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.199410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.199843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.216314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:55.218512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:55.225446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.225930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.226366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.227083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.227538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.227961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.230271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-08ec5820-4ce6-44f9-ac92-1ae6fa586b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Oct 19 22:11:55.230829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 805/1620] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:55.238604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:55.240712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:55.246421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.246896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.247482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.248087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.248530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.248947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.257869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-73d6b076-1346-43d6-8d74-777091bfda42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Oct 19 22:11:55.258438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 816/1621] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:55.274004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:55.276169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:55.278971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-89c8516d-72a0-432c-a0eb-4f61f2f8a922 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Oct 19 22:11:55.279536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 806/1622] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:55.281832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.282313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.282746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.283459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:55.283914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:55.284335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:55.313492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-48a082ce-1bcc-495e-a50a-aecc277b4f8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043766 Oct 19 22:11:55.314029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 817/1623] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:56.241957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:56.244090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:56.250023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.250502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.250929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.251630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.252075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.252497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.281665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:56.281665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:56.281665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.281665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.282419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.282419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.282419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.282419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.282773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2d5a0f4-d361-4b4b-aa03-5255ca96fa28 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Oct 19 22:11:56.282773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 807/1624] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:56.291551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:56.293888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:56.299727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.300210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.300645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.301368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.301815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.302231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.313905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03e71acc-fb2c-4cc4-89a6-ecf7422a3692 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048075 Oct 19 22:11:56.314469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 818/1625] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:56.325468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:56.327593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:56.331617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-931528d3-9f2a-487e-8208-85a0201b88b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Oct 19 22:11:56.332177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 808/1626] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:56.333276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.333791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.334226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.334923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:56.335405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:56.335975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:56.367209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e69b4cc4-a57a-490a-83fd-ddfd1461ed54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045499 Oct 19 22:11:56.367758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 819/1627] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:57.295148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:57.297318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:57.304194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.304683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.305120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.305818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.306358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.306685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.326920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:57.329782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:57.336929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.337416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.337871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.338570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.339044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.339473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.341869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-add6e1d7-8053-40fa-a331-a11a53ba6457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050484 Oct 19 22:11:57.342447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 809/1628] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:57.347181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:57.349279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:57.355421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.355895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.356329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.357009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.357462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.357880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.369698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c77fab74-5143-4f32-a7c3-6621eaaacbd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047670 Oct 19 22:11:57.374310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 820/1629] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:57.379098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:57.381321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:57.387181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.387660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.388032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6bd894f-ac63-4657-b229-3360c0424f56 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Oct 19 22:11:57.388165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.388596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 810/1630] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:57.388766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:57.389212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:57.389631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:57.418901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-64a796ed-4733-47b3-8ee8-b4c2e81da4d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043613 Oct 19 22:11:57.419476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 821/1631] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:11:58.354134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:58.356277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:58.362474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.362947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.363405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.364086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.364531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.365055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.383643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:58.385842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:58.392397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.393002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.393437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.395672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.396139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.396266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-32ce1b1e-ffc1-40e9-83c3-d54cddfd2583 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Oct 19 22:11:58.397127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.397520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 811/1632] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:58.402361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:58.404179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:58.409841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.410319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.410870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.411587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.412039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.419072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.432260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b9902ea1-36b2-47db-b560-966b56aa782b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053545 Oct 19 22:11:58.432883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 822/1633] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:58.440891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:58.442631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7eee8f6e-1bf2-4cc5-8e09-5ae2d8fee6b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Oct 19 22:11:58.443068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:58.443284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 812/1634] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:58.449025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.449560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.449988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.450681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:58.451157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:58.451579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:58.481172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8b59c8db-dd5b-459c-bd39-5b4ab993a171 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047314 Oct 19 22:11:58.481720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 823/1635] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:11:59.408629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:59.410718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:59.417784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.418267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.418706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.419435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.419890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.420318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.444825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:59.446962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:59.448256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:59.451060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e7592ea0-78d3-44fa-8c8f-49868273fa67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Oct 19 22:11:59.451629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 813/1636] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:59.453812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.454489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.455177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.456081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.456359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:59.456533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.457190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.458450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:59.464167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.464646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.465086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.465780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.466236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.466661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.483469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:11:59.488033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-20916903-01c9-479d-aa31-1b1c246505bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047683 Oct 19 22:11:59.488945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 824/1637] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:11:59.494105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:11:59.496234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:11:59.497056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed22fc82-0f28-40de-a0b7-65d95811039b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Oct 19 22:11:59.497808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 814/1638] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:11:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:11:59.502151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.502624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.503084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.503782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:11:59.504234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:11:59.504656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:11:59.532919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fc16a602-9272-4f6b-b6c4-b37c833faee3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042998 Oct 19 22:11:59.533467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 825/1639] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:11:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:00.464695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:00.466716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:00.473084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.473571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.474006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.475386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.475850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.476278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.507338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:00.507338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:00.507842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b8387570-645f-4eb0-a3b3-5d41ee86a641 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045764 Oct 19 22:12:00.507842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 815/1640] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:00.510204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.510690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.511166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.511868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.511973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:00.512326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.512748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.514102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:00.519728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.520203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.520636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.521316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.522274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.522692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.543064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5540ae0a-4773-4d92-9c26-cb24cc061c7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Oct 19 22:12:00.543626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 826/1641] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:00.548144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:00.550237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:00.552253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-145ca8ad-f029-4246-9850-015bd65db614 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043686 Oct 19 22:12:00.553059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 816/1642] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:00.556421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.556908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.557612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.558313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:00.558770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:00.559225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:00.592967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-63d5c9c6-648d-4541-beb5-e9845ebe8c5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048341 Oct 19 22:12:00.593517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 827/1643] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:01.531112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:01.531112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:01.531112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.531112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.531786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.531786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.531786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.531786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.555362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:01.557770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:01.562744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bfc7be7b-30e4-4561-ae1b-fa1e1eb199bf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048046 Oct 19 22:12:01.563794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 817/1644] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:01.565084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.565577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.566020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.566728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.567214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.567645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.568973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:01.571100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:01.578137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.578631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.579098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.579973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.580587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.581172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.598793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5a04a4c5-2a3b-4db2-9cf2-e15446ab51b7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Oct 19 22:12:01.600556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 828/1645] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:01.606213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:01.608353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:01.612997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-20ee38a3-a7d8-46c0-bd31-ce2c3821af84 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048097 Oct 19 22:12:01.613762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 818/1646] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:01.614267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.614745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.615224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.615930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:01.616379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:01.616799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:01.645907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c749a97d-2bd7-465a-bbc4-0316613a4d6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043796 Oct 19 22:12:01.646473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 829/1647] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:02.574110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:02.576344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:02.582630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.583151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.583599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.584285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.584742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.585169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.611215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:02.613415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:02.615173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d0419315-4d87-4c34-8c0f-18d09b175f00 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Oct 19 22:12:02.616516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 819/1648] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:02.620580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.621064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.621702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.622411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.622866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.623322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.627039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:02.628935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:02.634888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.635410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.635852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.636557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.637015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.637826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.653733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e940b3d9-7adb-4618-9937-60edea4a139a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Oct 19 22:12:02.654301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 830/1649] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:02.658836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:02.660963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:02.667175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.667691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.668127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.668672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c8ec3a1c-f03c-448e-9a0a-8156edb59b9c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045637 Oct 19 22:12:02.668826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:02.669240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 820/1650] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:02.669355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:02.669688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:02.698198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3a80197-1285-4974-bcf5-a50110e5b59d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042913 Oct 19 22:12:02.698741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 831/1651] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:03.628718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:03.630920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:03.637979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.638469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.638905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.639637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.640091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.640521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.665702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:03.668049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:03.671141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c00d3767-3642-41de-b2d3-7a8eb75684a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045884 Oct 19 22:12:03.675522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 821/1652] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:03.675857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.675857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.675857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.676097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.676556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.677003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.681200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:03.683668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:03.689336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.689820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.690255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.690970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.691779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.691911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.708548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-627195d0-3511-4423-9301-734a1ddb1b79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Oct 19 22:12:03.709160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 832/1653] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:03.713828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:03.715957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:03.721511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.721991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.722430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.723153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:03.723609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:03.724030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:03.726631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0e7fa1e2-2277-40e3-af33-c8923d651f02 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049661 Oct 19 22:12:03.727245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 822/1654] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:03.753123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-368bc178-6ef6-4a0b-8397-e4b4a99efa19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 Oct 19 22:12:03.753662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 833/1655] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:04.683706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:04.685829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:04.692311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.692801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.693237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.694431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.694908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.695364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.720229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:04.722357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:04.725984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f128dbc4-5e94-46e6-b94f-16e2ee8f1650 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Oct 19 22:12:04.726754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 823/1656] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:04.728745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.729225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.729655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.730376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.730827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.731278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.738729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:04.740951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:04.746860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.747380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.747814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.748509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.748961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.749384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.763578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76b47662-c4c8-427f-aadb-e59312de63c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Oct 19 22:12:04.764132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 834/1657] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:04.768857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:04.770993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:04.777169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.777670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.778102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.778816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:04.779291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:04.779708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:04.779917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ecf701b-5cd6-4e68-8928-1df189d8d8fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Oct 19 22:12:04.780475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 824/1658] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:04.809411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ae5b76d0-a8ba-49e6-95eb-44a52385f201 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044108 Oct 19 22:12:04.809967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 835/1659] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:05.738370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:05.740655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:05.747147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.747632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.748070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.748764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.749232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.749627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.778697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:05.779220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b2661ed4-5203-46d4-b8c0-a5824885ede1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044747 Oct 19 22:12:05.779787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 825/1660] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:05.782085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:05.793034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:05.795498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:05.799716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.800215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.800712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.801426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.801890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.802062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.802317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.802513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.802922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.803649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.804097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.804649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.834913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-72d795b0-8259-48b9-bce5-6121594faf4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Oct 19 22:12:05.835669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 826/1661] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:05.839359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-299fdc6a-8c47-4b8f-9484-e176fcc29a70 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067466 Oct 19 22:12:05.839921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 836/1662] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:05.841181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:05.843344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:05.849079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.850171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.850616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.851356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:05.851815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:05.852240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:05.880073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-db799cc4-387e-446b-b1a9-4b39a4f718d2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042837 Oct 19 22:12:05.880620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 827/1663] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:06.792188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:06.794312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:06.800616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.801117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.801549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.802239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.803318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.803747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.832121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6cea56d9-ea04-49bf-be97-4ad64fce1cf4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Oct 19 22:12:06.832708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 837/1664] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:06.847220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:06.849986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:06.851823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:06.853876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:06.856820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:06.857408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.857851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.858371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.859171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.859697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.860123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.860438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.860597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.861030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.861717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.862168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.862638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.890816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b8eb8afb-a8ea-4736-a534-72a1f0645af1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Oct 19 22:12:06.892078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 828/1665] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:06.892299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6f01a057-46e7-495e-9b21-8d05691ac02b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Oct 19 22:12:06.893045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 838/1666] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:06.896231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:06.898421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:06.904238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.904722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.905157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.905853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:06.906312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:06.906739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:06.936857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6afaeb7e-7269-4eb1-b3ac-43e7831efebb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044211 Oct 19 22:12:06.937399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 829/1667] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:07.844406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:07.846654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:07.853348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.853835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.854274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.855022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.855482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.855911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.885932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5ed2d76e-ffe4-4402-bf5d-ad482faf430a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Oct 19 22:12:07.886637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 839/1668] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:07.905428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:07.907411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:07.908193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:07.909683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:07.915071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.915402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.915768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.915874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.916379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.916512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.917008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.917357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.917457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.917879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.918072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.918595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.936536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:07.950173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c6754c04-ca9e-4f17-992c-6d260cd369a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049516 Oct 19 22:12:07.950740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a8ea0285-5656-457f-8410-1ca7626fbc9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047130 Oct 19 22:12:07.950897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 830/1669] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:07.951764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 840/1670] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:07.955296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:07.957390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:07.959149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:07.963796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.964311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.964753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.965447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:07.965910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:07.966370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:07.995910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-002dd2db-5aab-46e2-9fca-da43a5323eb4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044163 Oct 19 22:12:07.996587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 831/1671] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:08.898167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:08.900426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:08.906742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:08.907275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:08.907709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:08.908404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:08.908857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:08.909276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:08.926513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:08.947847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3e01b3bc-fb0f-4831-a3b0-e24d98cf8d6f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045957 Oct 19 22:12:08.947847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 841/1672] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:08.964279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:08.964981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:08.966925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:08.967305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:08.973387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:08.973878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:08.973989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:08.974315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:08.974434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:08.975588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:08.976324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:08.976447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:08.976779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:08.977023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:08.977551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:08.977676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:09.007716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ffc75190-6401-4ed4-ae8a-e051a65a39b0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049397 Oct 19 22:12:09.008275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 832/1673] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:09.008477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9caec65a-bb0a-47cd-bee2-3c7a17701321 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048177 Oct 19 22:12:09.009209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 842/1674] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:09.012890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:09.014979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:09.020574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:09.021047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:09.022067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:09.022744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:09.023214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:09.023632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:09.051791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-afe1b585-d12a-412d-9577-3e83b3d4b2fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042496 Oct 19 22:12:09.052264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 833/1675] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:09.957700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:09.959862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:09.966143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:09.966628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:09.972198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:09.972198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:09.972198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:09.972198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:09.999268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d8f19e8a-013f-4f5f-9c07-8623f2d0bb72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Oct 19 22:12:10.000010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 843/1676] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:10.020474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:10.022631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:10.024691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:10.026818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:10.029311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:10.029860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:10.030293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:10.031054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:10.031518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:10.031951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:10.033387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:10.033870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:10.034296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:10.035074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:10.036918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:10.036918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:10.063983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b7dcea58-5319-495b-92ff-4930778dcfff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Oct 19 22:12:10.064548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 834/1677] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:10.068110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01c00665-c0f0-4fee-ba61-ec25b971a323 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048072 Oct 19 22:12:10.068699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 844/1678] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:10.074516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:10.076760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:10.082556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:10.083076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:10.083513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:10.085712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:10.085712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:10.085712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:10.119842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-96ab2bb3-9b62-491d-9661-ed7d30f8e67c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054273 Oct 19 22:12:10.120405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 835/1679] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:11.011684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:11.013816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:11.020169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.020715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.021154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.021879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.022332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.022751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.053591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-630e36ab-4062-401b-8f24-09dc0fa999cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Oct 19 22:12:11.054292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 845/1680] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:11.077064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:11.079830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:11.080379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:11.082513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:11.086703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.087248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.087698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.088407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.088862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.089270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.089397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.089754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.090187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.090888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.091365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.091790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.121870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8dc4eaf5-b0b8-45f6-9c58-025afae788e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049377 Oct 19 22:12:11.122607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 836/1681] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:11.122749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-adf2f06c-22b5-483f-a298-3cf543b6ea01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046044 Oct 19 22:12:11.123271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 846/1682] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:11.132551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:11.134694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:11.140535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.143394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.143394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.143394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:11.143394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:11.143766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:11.170966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-35c24d05-060b-470f-a341-d884ffee82b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042711 Oct 19 22:12:11.171520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 837/1683] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:12.065726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:12.067877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:12.074701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.075222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.075655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.076348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.076798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.077224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.111192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c85b99de-8e20-41e6-af01-f9641c4bde4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049379 Oct 19 22:12:12.111761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 847/1684] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:12.136222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:12.136745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:12.136862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:12.136971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:12.142607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.143140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.143582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.143755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.144284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.144395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.144740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.145051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.145166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.146214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.146819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.147361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.177549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dddc3cb6-433c-4d21-9ef2-0a493c521fd9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046995 Oct 19 22:12:12.178621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-14b4209d-cc3d-4eed-987c-569560fcbf16 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048198 Oct 19 22:12:12.178893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 848/1685] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:12.179781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 838/1686] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:12.183753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:12.185837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:12.191660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.192136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.192563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.193299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:12.193747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:12.194166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:12.221981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac19e644-82e5-4a52-b896-34a84afb7c21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042110 Oct 19 22:12:12.222518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 849/1687] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:13.124869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:13.127024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:13.133144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.133628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.134071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.134766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.135242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.135702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.165947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fd40ac58-7253-44e7-9341-263ef166c1bc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Oct 19 22:12:13.166725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 839/1688] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:13.191643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:13.192136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:13.193863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:13.194015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:13.199911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.200406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.200837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.201129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.201622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.201756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.202055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.202181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.202591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.202771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.203413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.203833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.233269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0d20a2d8-4fbc-4f98-8e4a-ec6fcc9deee0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Oct 19 22:12:13.233819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 840/1689] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:13.234709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d59dc673-a1a5-4f41-951a-ee492367af43 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046929 Oct 19 22:12:13.235552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 850/1690] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:13.238352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:13.240540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:13.246157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.246637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.247109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.247797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:13.248248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:13.248670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:13.277653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e44967f-dc9f-4c90-a7dd-0113f612c524 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042804 Oct 19 22:12:13.278127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 841/1691] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:14.178395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:14.180903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:14.187143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.187632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.188063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.189094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.189224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.189659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.218752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a5f94544-3c8a-4ae3-b73a-29e4113aa03a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Oct 19 22:12:14.219645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 851/1692] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:14.246475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:14.248670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:14.248799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:14.250786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:14.255410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.257023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.257160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.257466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.257654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.258069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.258184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.258752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.258870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.259222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.259343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.259650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.291165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0af74a18-5bca-467d-b7ba-e73e7fab24e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048576 Oct 19 22:12:14.291543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 842/1693] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:14.295876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4e96631-bd3c-4516-ae67-582177601087 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052405 Oct 19 22:12:14.296193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:14.296574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 852/1694] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:14.298436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:14.304746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.305223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.305657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.306350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:14.306802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:14.307498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:14.335848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-905e3794-5d56-4baa-a84e-dfcb0463739c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043252 Oct 19 22:12:14.336327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 843/1695] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:15.231251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:15.233385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:15.239838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.240322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.240759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.241448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.241966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.242398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.272455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2694ca3f-c98b-4fd7-895e-fb10e504782d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Oct 19 22:12:15.273019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 853/1696] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:15.303210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:15.305876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:15.308350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:15.310576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:15.312820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.313301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.313916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.314606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.315089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.315506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.316500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.316996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.317430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.318627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.319114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.319543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.347545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-33838a4d-a468-42fb-b193-66fb4c565944 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048452 Oct 19 22:12:15.348098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 844/1697] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:15.349990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0286a2eb-820e-4810-ba61-6eeee7d1811d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045719 Oct 19 22:12:15.350763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 854/1698] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:15.352646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:15.354731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:15.360738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.361216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.361649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.362328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:15.362781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:15.363222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:15.392523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e4502a44-0634-470e-9061-d5c2392f5694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043468 Oct 19 22:12:15.393062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 845/1699] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:16.284951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:16.287152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:16.293430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.293906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.294334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.295123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.295606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.296032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.327390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b7cacf59-266b-4f7a-a9e2-b4b2df201ee3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046430 Oct 19 22:12:16.327952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 855/1700] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:16.359927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:16.361777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:16.362046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:16.363901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:16.369162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.369848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.370354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.370502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.370839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.371168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.371329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.371620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.371994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.372098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.372449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.372872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.402803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4f95e908-c9cd-4511-8a11-6bb9d9140077 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Oct 19 22:12:16.403391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 846/1701] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:16.407536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a84eb250-b9e5-4794-b6ca-9584317465c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049715 Oct 19 22:12:16.408297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:16.411005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 856/1702] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:16.411166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:16.416250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.416753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.417184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.417870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:16.418318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:16.418743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:16.422355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:16.449276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c80ea4d5-55e1-4e6b-a7b9-22b4b14d57d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044820 Oct 19 22:12:16.449834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 847/1703] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:17.340309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:17.342509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:17.349207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.349705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.350139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.350827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.351308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.351730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.381757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c1d0246b-2a36-474a-a197-4663e4bf520d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045331 Oct 19 22:12:17.382512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 857/1704] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:17.414804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:17.417884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:17.420891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:17.422683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:17.424698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.425599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.425747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.426444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.426898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.427343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.428647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.429142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.429574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.430305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.432726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.432726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.436056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:17.461757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d91c842c-72b9-4c85-a4a7-589397a49e74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050822 Oct 19 22:12:17.462731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 848/1705] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:17.463908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b11aa743-983e-469e-b0f8-63ab9a414fd2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047613 Oct 19 22:12:17.467093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 858/1706] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:17.468001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:17.470332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:17.475993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.476470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.476932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.477615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:17.478082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:17.478556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:17.508520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-12e94cc9-aace-4a72-b8b7-4fc25b3bf98f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044564 Oct 19 22:12:17.509079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 849/1707] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:18.394433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:18.397143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:18.403644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.404101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.404531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.405212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.405660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.406082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.436529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6d524736-55b0-47c3-96f2-a9e26872bc4c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046344 Oct 19 22:12:18.437152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 859/1708] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:18.473926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:18.477391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:18.477531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:18.480066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:18.484463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.484794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.485441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.486139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.486587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.486718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.487043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.487653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.488251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.488942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.489708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.490309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.520543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f61dc799-4fe4-4eec-9881-ce42108da61e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047687 Oct 19 22:12:18.521100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 860/1709] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:18.526532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:18.528639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:18.528763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a0283803-b420-479e-af0f-fc85ffae0591 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058880 Oct 19 22:12:18.529272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 850/1710] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:18.534263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.534737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.535207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.535924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:18.537963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:18.538382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:18.566749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-49766518-cd04-4f4a-9b2e-084fbc8fa566 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044137 Oct 19 22:12:18.567470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 861/1711] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:19.449560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:19.451723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:19.457559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.458034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.458462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.459243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.459691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.460107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.488120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ba8879a-7f25-4a42-8d97-0c70dd46bb0f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Oct 19 22:12:19.488673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 851/1712] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:19.533328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:19.536170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:19.543275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:19.544823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.545313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.545753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.545879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:19.546453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.547048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.547360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.552234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.553294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.553759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.555026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.555486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.555992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.581175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0851d101-843d-4623-923c-c73b0493d5a2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051763 Oct 19 22:12:19.581970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 862/1713] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:19.586361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-99991ece-d89c-4b5c-ac18-9444283a9a1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048037 Oct 19 22:12:19.586604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:19.586918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 852/1714] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:19.588878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:19.594515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.595028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.595469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.596163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:19.596619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:19.597043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:19.638441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-10e3d235-3b40-4606-916c-cc1f2f45feae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055459 Oct 19 22:12:19.639031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 863/1715] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:20.511276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:20.513416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:20.519765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.520250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.520688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.521981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.522438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.522866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.552126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b26b6036-0b2f-49a8-b959-2b5a2a3401a1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Oct 19 22:12:20.552688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 853/1716] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:20.594341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:20.596632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:20.598691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:20.601233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:20.604234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.604601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.605107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.605881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.606406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.606899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.607267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.607705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.608146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.608843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.609402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.609726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.641517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0cc05836-8f7d-4c71-bfba-977274b88208 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051903 Oct 19 22:12:20.641937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e62b5121-66a9-4beb-b4e6-f30d8c390891 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048288 Oct 19 22:12:20.642375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 864/1717] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:20.642499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 854/1718] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:20.652246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:20.654361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:20.660033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.660508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.660941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.661617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:20.662088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:20.662521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:20.691772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c972273f-770f-4ebf-961c-501cdcc65f1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043186 Oct 19 22:12:20.692319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 865/1719] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:21.564781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:21.566911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:21.573478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.573957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.574391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.575207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.575619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.576045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.605834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bb8244df-797e-422c-b04c-887e26d3bdbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Oct 19 22:12:21.606407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 855/1720] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:21.656001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:21.658385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:21.659262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:21.666253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:21.666921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.667444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.667886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.668588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.669044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.669471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.672650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.674140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.674140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.674453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.674868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.675330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.701894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62dad6aa-cee2-4d31-abb4-0e8cd5b5a46c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050699 Oct 19 22:12:21.702466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 866/1721] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:21.705956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a1b43d7b-459d-4272-8784-d58ee68d9c49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051430 Oct 19 22:12:21.711086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 856/1722] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:21.712162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:21.714325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:21.720065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.720561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.720986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.721681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:21.722137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:21.722562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:21.751471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3f0b727d-4ea2-4572-be59-067d27cbbadd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Oct 19 22:12:21.752011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 867/1723] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:22.618800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:22.621025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:22.627442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.627924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.628360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.629050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.629506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.629932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.657607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fa11a982-f190-4e3b-8cd9-487fc0ca2f1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043351 Oct 19 22:12:22.658148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 857/1724] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:22.715479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:22.717498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:22.718790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:22.721386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:22.725060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.725541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.725976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.726682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.727178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.727591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.728570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.729183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.729712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.730769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.731251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.731670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.759693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9377d7cb-d350-4524-a089-7c1042158c2a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048088 Oct 19 22:12:22.764359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 868/1725] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:22.764507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cfd4c358-d656-4f74-bace-6d694ce3c8c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Oct 19 22:12:22.764507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 858/1726] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:22.845246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:22.847449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:22.853772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.854251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.854683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.855396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:22.855847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:22.856268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:22.885128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-535b131f-5e34-4cda-b201-daae5a549cd5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123462 Oct 19 22:12:22.885615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 869/1727] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:23.670802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:23.673019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:23.679873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.680345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.680773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.681450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.681899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.682323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.711363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82b41ba8-ab96-4124-98b0-b564b2a377b1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Oct 19 22:12:23.711905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 859/1728] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:23.771782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:23.775774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:23.777184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:23.779363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:12:23.779599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:12:23.779718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:23.785909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.786109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.786514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.787549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.788124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.788745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.788994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.789214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.789647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.790510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.791604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.792259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.822409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7638766a-2074-4c86-8380-0fa97836765d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049327 Oct 19 22:12:23.822977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 860/1729] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:23.836023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-131aa05f-e137-43c3-bd25-35587e1f96d9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068183 Oct 19 22:12:23.836574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 870/1730] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:23.897407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:23.900016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:23.905728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.906201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.906631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.907338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:23.907810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:23.908226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:23.936957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-779fef20-9c6b-47e8-9722-89ca648c0f2c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043383 Oct 19 22:12:23.937424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 861/1731] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:24.723859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:24.726005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:24.731934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.732415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.732850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.733532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.733983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.734404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.763929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-65a14823-319b-4547-ae72-60d436913889 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Oct 19 22:12:24.764467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 871/1732] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:24.834722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:24.836888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:24.843770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.844271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.844668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.845352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.845799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.846209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.848630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:24.851293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:24.857820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.858311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.858748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.859654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.860111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.860712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.877124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-66078a89-dacd-4dc5-96ab-8c8f9dc51e43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Oct 19 22:12:24.877684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 862/1733] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:24.890926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6dd23c95-2474-4d7a-8efb-1a7b189694dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 Oct 19 22:12:24.891508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 872/1734] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:24.949279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:24.951391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:24.957106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.957581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.958011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.958740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:24.959212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:24.959633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:24.983587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:24.987950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-594d8151-319d-4f9e-af69-00c1e18b2e97 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042540 Oct 19 22:12:24.988481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 863/1735] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:25.777340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:25.779543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:25.785512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:25.785997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:25.786436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:25.787190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:25.787651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:25.788078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:25.816743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2cff31ab-5573-4e4b-b217-055295bb43ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043372 Oct 19 22:12:25.817305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 873/1736] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:25.889249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:25.891516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:25.898528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:25.899049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:25.899491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:25.900196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:25.901354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:25.901709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:25.903616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:25.906199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:25.912996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:25.913481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:25.913978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:25.914618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:25.915236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:25.915662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:25.932862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9379c4e2-a531-4209-ba3e-e2668db91e55 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047094 Oct 19 22:12:25.933586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 864/1737] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:25.942177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:25.947535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1e5e2501-72c5-4867-ad91-d69946a2abcb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048233 Oct 19 22:12:25.948094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 874/1738] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:26.000738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:26.002860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:26.009213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.009703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.010136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.010822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.011306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.011733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.040012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09366321-4ff8-4e0c-9bdb-f9ca38ff91de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043146 Oct 19 22:12:26.040559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 865/1739] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:26.830038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:26.832219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:26.838261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.838740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.839203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.839890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.840337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.840759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.868976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9adadffe-2ca4-4ccc-9320-9f1fd58a3926 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043261 Oct 19 22:12:26.869517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 875/1740] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:26.950156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:26.952297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:26.959027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.959238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.959673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.959862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:26.960386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.960811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.961228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.962354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:26.968751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.969243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.969741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.970441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:26.970897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:26.971534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:26.995658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dc0fc3d5-41a4-49a7-865e-da834eb36a0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049240 Oct 19 22:12:26.996223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 866/1741] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:27.001483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a89af624-ed81-4752-9301-c43e13819d5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045575 Oct 19 22:12:27.002036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 876/1742] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:27.052362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:27.054966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:27.060996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:27.061473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:27.061908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:27.062591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:27.063067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:27.063495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:27.091440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7aebaa69-5292-4beb-94b0-71d67ced2f3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043025 Oct 19 22:12:27.092004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 867/1743] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:27.881774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:27.883923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:27.889744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:27.890229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:27.890660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:27.891369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:27.891819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:27.892235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:27.920568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4ca78472-f7a8-40e4-950f-3456e5356503 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Oct 19 22:12:27.921038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 877/1744] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:28.008650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:28.010831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:28.013804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:28.016200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:28.017477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.017973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.018442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.019133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.019587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.020008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.023231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.023727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.025212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.025212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.025411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.025838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.050465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8d4f2dd0-5464-4ea0-aa8b-9e90e4c8c707 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046382 Oct 19 22:12:28.051039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 868/1745] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:28.055693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bf944779-f7aa-4367-91fd-059f7d697e31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Oct 19 22:12:28.056256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 878/1746] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:28.103662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:28.105775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:28.111593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.112081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.112507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.113190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.113642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.114065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.143637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37a17777-8f13-4c52-9c10-82b6ee1b8dc3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043648 Oct 19 22:12:28.144189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 869/1747] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:28.933607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:28.935783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:28.941776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.942257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.942688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.944028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:28.944481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:28.944904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:28.972743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0ab5bd16-2420-4727-9829-3d5aa8f56c54 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Oct 19 22:12:28.973284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 879/1748] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:29.065258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:29.067666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:29.069059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:29.071489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:29.075354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.076802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.077218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:29.078136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.078435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.078557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.079042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:29.079833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.079945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.080310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:29.080432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.080832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:29.112686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-236a6a48-4d4a-40aa-a6b6-db499aea129d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048036 Oct 19 22:12:29.113248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 880/1749] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:29.117795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1b98ddf0-6da0-4ab8-9fdb-1e12bc363381 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057318 Oct 19 22:12:29.118342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 870/1750] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:29.156160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:29.158300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:29.164151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.164626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.165054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:29.165737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.166187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.166607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:29.196089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-91419178-1256-4ca4-b39a-3a18d191ad5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044026 Oct 19 22:12:29.196636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 881/1751] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:29.985213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:29.987353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:29.993222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.993695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.994127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:29.994806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:29.995288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:29.995703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:30.025256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8cb73a8f-0709-48a7-9aac-d9ea4ffc6ef8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Oct 19 22:12:30.025824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 871/1752] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:30.131414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:30.132279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:30.133567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:30.134590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:30.140207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:30.140690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:30.141123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:30.141655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:30.141784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:30.141869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:30.142215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:30.142457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:30.142719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:30.142901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:30.143372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:30.144024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:30.175820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-02ea87a4-f1e6-4b54-a244-bf083139ed2f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Oct 19 22:12:30.176655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 882/1753] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:30.177477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4f419dc8-82d1-474c-8f98-dc34c50bb7a5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050379 Oct 19 22:12:30.178030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 872/1754] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:30.208280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:30.210935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:30.216866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:30.217343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:30.217775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:30.218824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:30.219310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:30.219735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:30.248839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4b9a50cc-b320-4a4b-b9aa-97a13cbe20a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044620 Oct 19 22:12:30.249381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 883/1755] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:31.037295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:31.039537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:31.045480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.045961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.046394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.047130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.047585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.048009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.076552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e928e15b-b357-4322-b56b-20bb033eaa40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 Oct 19 22:12:31.077096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 873/1756] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:31.189353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:31.189948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:31.191497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:31.191981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:31.197903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.198132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.198561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.199286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.199501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.199736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.200155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.200512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.200955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.201653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.202111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.202849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.230638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-06470ff7-b0de-408a-84db-20d2753f6d84 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Oct 19 22:12:31.231225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 874/1757] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:31.234598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76eca1ab-4d5e-4bc7-afd0-882736010034 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050148 Oct 19 22:12:31.235181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 884/1758] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:31.260948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:31.263101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:31.268780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.269253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.269683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.270363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:31.270802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:31.271784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:31.300343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5ecc3785-c0cd-4fad-9928-379399415523 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043142 Oct 19 22:12:31.300834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 875/1759] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:32.088956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:32.091170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:32.097256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.101414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.101414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.101414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.101414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.101771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.128187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-80856ad8-1b16-4406-b86d-1dcb5f878a14 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Oct 19 22:12:32.128739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 885/1760] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:32.245005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:32.246824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:32.247410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:32.248955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:32.253717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.254201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.254650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.255449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.256173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.256413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.256654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.256836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.257086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.257769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.258215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.258631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.287372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa74a499-857f-4f99-9cb4-cf3cb4513983 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Oct 19 22:12:32.288070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 876/1761] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:32.292387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4252c71-8a54-4078-acc1-037bbc2ec1fe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049484 Oct 19 22:12:32.292942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 886/1762] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:32.312415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:32.314521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:32.320289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.320770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.321206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.321897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:32.322353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:32.322781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:32.352089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8b9631f-8f66-4130-b82c-7aaf47cc81c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043322 Oct 19 22:12:32.352567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 877/1763] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:33.141615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:33.143785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:33.150385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.150873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.151342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.152034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.152537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.152964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.180948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-53567f50-f807-4ffd-99ea-1681cf36de45 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Oct 19 22:12:33.181499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 887/1764] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:33.304547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:33.306684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:33.308780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:33.312041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:33.314045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.314191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:33.314524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.315086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.315763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.316386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.316818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.321433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.321918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.322348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.323071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.323522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.323942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.348198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-60d7797b-d988-4074-8335-19fd93077621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047553 Oct 19 22:12:33.348772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 888/1765] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:33.354623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e07436c4-c195-4d5f-b26f-9d8e61839872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058813 Oct 19 22:12:33.355206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 878/1766] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:33.364403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:33.367168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:33.373379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.373862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.374298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.375040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:33.375498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:33.375920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:33.405623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-edbc7977-93b2-4e5e-b1da-885eb8155207 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045045 Oct 19 22:12:33.406120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 889/1767] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:34.193617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:34.195763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:34.201963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.202432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.202855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.203557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.204004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.204420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.232385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-17741a0e-4bed-4a64-85e3-78c280a2341d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Oct 19 22:12:34.233134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 879/1768] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:34.360379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:34.363872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:34.366533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:34.368727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:34.373112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.373605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.374574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.375246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.375364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.375730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.375842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.376164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.376779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.376902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.377287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.377705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.395659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:34.408895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c34084be-f8eb-449b-9955-39d7b142ed5d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046521 Oct 19 22:12:34.409503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 880/1769] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:34.411579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7fe48041-0b55-43ef-883c-070ef5ff53c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055042 Oct 19 22:12:34.412138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 890/1770] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:34.419331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:34.421787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:34.423675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:34.430006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.432392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.432392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.432392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:34.432392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:34.433114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:34.462158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e2687333-b611-4f4b-8bc2-6d803071d91f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047175 Oct 19 22:12:34.462646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 881/1771] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:35.245488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:35.247707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:35.253638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.254118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.254553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.255354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.256479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.256978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.273602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:35.286024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3684fe3-5a34-45af-aad4-1f54025c2f03 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044632 Oct 19 22:12:35.287121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 891/1772] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:35.421540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:35.424256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:35.426035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:35.429805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:35.431536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.432155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.432834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.433666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.434122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.434545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.436916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.437393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.437824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.438787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.440071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.440523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.463911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ee96ba7-700d-4196-b9ce-146fd0514975 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Oct 19 22:12:35.464474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 882/1773] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:35.469985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8bfc51d9-9372-4d47-a1dc-f237d5b6f191 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048062 Oct 19 22:12:35.470541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 892/1774] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:35.473748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:35.476402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:35.482074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.482548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.483003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.483687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:35.484142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:35.484565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:35.513191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-54cf864b-b0c2-4a8d-a63a-15520e435dc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043396 Oct 19 22:12:35.513662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 883/1775] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:36.298896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:36.301086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:36.307902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.308372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.308800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.309475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.309921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.310336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.338175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2bf0da04-a9f6-4254-a2e7-4bfce3fc779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Oct 19 22:12:36.338716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 893/1776] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:36.477868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:36.480035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:36.481677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:36.483980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:36.486895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.487508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.487937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.488629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.489082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.489484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.490278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.490755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.491216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.491907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.492451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.492768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.518971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2c9d65fc-3f69-4e60-90b3-67aa60bd8f27 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 Oct 19 22:12:36.519543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 884/1777] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:36.525486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-13b69808-f0a6-4449-96d1-2c0316afa721 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047534 Oct 19 22:12:36.525811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:36.526285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 894/1778] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:36.527926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:36.533543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.534014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.534441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.535147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:36.535594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:36.536009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:36.564700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4939a121-3b51-4528-b9f4-5a745b9cdb37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042512 Oct 19 22:12:36.565170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 885/1779] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:37.351254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:37.353534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:37.359483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.359969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.360404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.361095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.361548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.361972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.390904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-028ca456-4d07-4a8f-9b19-56a6c919f9fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Oct 19 22:12:37.391483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 895/1780] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:37.532178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:37.534703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:37.537878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:37.540181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:37.545652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.546151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.546372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.546591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.547077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.547325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.547783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.548015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.548209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.549019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.549655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.550283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.582555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2116cc5a-0cc2-44ee-bba7-38af81b62a71 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048623 Oct 19 22:12:37.582975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6b2bc511-c687-4c56-b2ce-486fcacc8719 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054716 Oct 19 22:12:37.584507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 896/1781] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:37.584637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 886/1782] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:37.588436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:37.588920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:37.589050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:37.591131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:37.595030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.595512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.595944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.596627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.596741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.597081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.597192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.597498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.597598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.598279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.598732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.599228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.622321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:12:37.627607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a78c9ba2-1f53-41a9-9ce7-66380e5570d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042326 Oct 19 22:12:37.628170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 887/1783] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:37.926144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5d298c77-acbe-4240-bd35-db58f4e7be53 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 204 len: 0 microversion: 2.1 time: 0.340981 Oct 19 22:12:37.926740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 897/1784] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:12:37 2022] DELETE /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:12:37.935652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:37.936264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:37.942306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.943398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.943839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:37.944522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:37.944970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:37.945403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.131560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:12:38.139063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b465261d-58f2-4d0d-8178-25cba74d2e29 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1689 microversion: 2.1 time: 0.207728 Oct 19 22:12:38.139610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 888/1785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:12:37 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1689 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:12:38.403963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:38.410048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:38.412599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.413071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.413498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.414174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.414665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.415109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.445242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-070fc09a-56e2-4b7c-af89-532196514b9f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Oct 19 22:12:38.445805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 898/1786] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:38.596681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:38.597320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:38.597991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:38.598657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:38.604597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.605028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.605471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.606146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.606437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.606590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.607034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.607213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.607733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.608530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.609179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.609587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.639842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-64056f4a-8ee2-45d5-97d9-8075e6f2ae01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047702 Oct 19 22:12:38.644487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 899/1787] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:38.645241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:38.647938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:38.648078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5e205a4f-c211-4cf7-88ec-0be6101676c0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055967 Oct 19 22:12:38.648866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 889/1788] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:38.653925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.654519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.654907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.655619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:38.656067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:38.656484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:38.686522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17bfddc8-3df9-445d-8a53-89ed40a31842 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044914 Oct 19 22:12:38.687325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 900/1789] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:39.161636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:39.162245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:39.168401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.168982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.169379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.170023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.170479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.170903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.258974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:12:39.266618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-10387c96-72fd-4b2b-bd0a-d25a81f81545 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1621 microversion: 2.1 time: 0.108915 Oct 19 22:12:39.267393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 890/1790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:12:39 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1621 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:12:39.460186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:39.462333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:39.468507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.468996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.469435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.470140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.470596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.471052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.509318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-f3713056-db66-4fee-a529-4fd012dfb904 req-ad93c73f-268c-4059-85a9-1ec27da66f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d879744-3a18-481b-a9ec-441278759057", "name": "network-vif-deleted", "tag": "d55a98d6-9b51-4575-9649-77cbfb1f5f1c"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:12:39.512296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3d1b61a0-59ed-4d8d-95d8-45b6fadf8341 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055773 Oct 19 22:12:39.516124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 891/1791] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:39.523219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-f3713056-db66-4fee-a529-4fd012dfb904 req-ad93c73f-268c-4059-85a9-1ec27da66f6e service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.523708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-f3713056-db66-4fee-a529-4fd012dfb904 req-ad93c73f-268c-4059-85a9-1ec27da66f6e service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.524425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-f3713056-db66-4fee-a529-4fd012dfb904 req-ad93c73f-268c-4059-85a9-1ec27da66f6e service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.537748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-f3713056-db66-4fee-a529-4fd012dfb904 req-ad93c73f-268c-4059-85a9-1ec27da66f6e service nova] Creating event network-vif-deleted:d55a98d6-9b51-4575-9649-77cbfb1f5f1c for instance 2d879744-3a18-481b-a9ec-441278759057 on hv-cinder-maste Oct 19 22:12:39.542802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-f3713056-db66-4fee-a529-4fd012dfb904 req-ad93c73f-268c-4059-85a9-1ec27da66f6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112012 Oct 19 22:12:39.543757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 901/1792] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:39.652474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:39.655159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:39.661336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:39.663687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:39.665759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.666473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.667285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.668085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.668693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.669204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.670079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.670512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.671172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.671964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.673737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.674195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.708516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f95962af-baec-4c6b-bfca-bf3d83bd6f40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059936 Oct 19 22:12:39.711155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 892/1793] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:39.711276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c409229a-3c72-42e9-b07b-04786e6ca652 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053433 Oct 19 22:12:39.714576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:39.714755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 902/1794] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:39.716824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:39.722872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.723387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.723813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.724543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:39.724970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:39.725389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:39.755044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-096ce69e-fbc4-46c8-b5c3-a7d1c0835e6a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044663 Oct 19 22:12:39.756190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 893/1795] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:40.290824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:40.291471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:40.297807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.298746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.299403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.300306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.301174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.301763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.341855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.342342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.342775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.343251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lazy-loading 'fault' on Instance uuid 2d879744-3a18-481b-a9ec-441278759057 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:12:40.441147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:12:40.448815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a7cbe0ed-a26f-4069-b2ac-638b1de08119 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 200 len: 1423 microversion: 2.1 time: 0.162763 Oct 19 22:12:40.449379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 903/1796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:12:40 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 1423 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:12:40.525671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:40.527822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:40.533757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.534258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.534685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.535386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.535881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.539753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.566153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4244cb89-b778-4197-b8ee-513bf19d97c3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Oct 19 22:12:40.568475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 894/1797] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:40.721232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:40.721784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:40.723483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:40.724229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:40.730021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.730504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.730799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.730933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.731317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.731660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.731767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.732107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.732517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.732607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.732966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.733388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.763523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-39b6b54c-2a61-4271-8597-c857d7bec4f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Oct 19 22:12:40.763969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c1b3ce72-71e6-41f2-8f6a-bc0aca1c0bf9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Oct 19 22:12:40.764094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 904/1798] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:40.764683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 895/1799] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:40.768610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:40.770698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:40.776950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.777425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.783976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.783976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:40.783976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:40.783976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:40.809697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d0cf4e7b-238c-43bf-a98f-bdbe0dde4bdc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044605 Oct 19 22:12:40.810254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 905/1800] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:41.471880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:41.472498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 2d879744-3a18-481b-a9ec-441278759057] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:41.479132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.479618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.480057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.480749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.481204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.481629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.495338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] HTTP exception thrown: Instance 2d879744-3a18-481b-a9ec-441278759057 could not be found. Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Request method failure captured: Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 HTTP/1.1 Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPnMonHOKSWNkwdVcXpHfQSFB0FjPD1po2qnoc2XPqTZ2ZlTWUk8iqedAofhJc06AFi5K5cbD_e9PoiR3SITTxboMA-_1XhTQFMTl5d7Q50xMRhDzqo01Dj_dsQdk40cHPBvQXYmXfrBMYDLNWTyzyTnNSMnIGF7-UbvkDZhMpX4jU Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:12:41.496985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65cb45d314f743799145a0fc614ce83e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}] Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 2c7d8acfab1041fc8edf36fd42b06993 Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 2d879744-3a18-481b-a9ec-441278759057 could not be found. Oct 19 22:12:41.498581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '2d879744-3a18-481b-a9ec-441278759057'} Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d879744-3a18-481b-a9ec-441278759057 could not be found. Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:12:41.499499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d879744-3a18-481b-a9ec-441278759057 could not be found. Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d879744-3a18-481b-a9ec-441278759057 could not be found. Oct 19 22:12:41.500964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:12:41.502230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Returning 404 to user: Instance 2d879744-3a18-481b-a9ec-441278759057 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:12:41.502230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf81db51-6dd5-4d3e-81af-04911ee32347 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057" status: 404 len: 111 microversion: 2.1 time: 0.030354 Oct 19 22:12:41.502230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 896/1801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:12:41 2022] GET /compute/v2.1/servers/2d879744-3a18-481b-a9ec-441278759057 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:12:41.506852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e2ad70af-9c10-4b53-bf45-5b3b0d19176a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '.version_select at 0x7f7332b5bc10>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:41.579493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:41.581604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:41.587480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.587958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.588388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.589071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.589549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.589971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.614278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:41.619539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8b3f60b2-0e0b-4594-a86e-1c660c03d2e8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Oct 19 22:12:41.620105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 897/1802] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:41.630009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e2ad70af-9c10-4b53-bf45-5b3b0d19176a tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509785875" status: 202 len: 0 microversion: 2.1 time: 0.126863 Oct 19 22:12:41.630584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 906/1803] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 19 22:12:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509785875 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:12:41.777023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:41.783401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:41.785563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:41.789077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:41.799184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.799987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.800427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.800554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.800958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.801134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.801396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.801931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.802216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.802517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.803084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.803509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.831301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:41.836687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ad995b0b-7bfc-4348-a3c6-69e345c3bf1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063616 Oct 19 22:12:41.837344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 898/1804] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:41.837730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-486aff31-1034-4d3e-9029-9786af82c506 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058720 Oct 19 22:12:41.839348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 907/1805] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:41.843923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:41.846177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:41.853057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.853551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.853985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.854696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:41.855180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:41.855608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:41.886383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c8de9636-8c07-4031-af5b-37d0094d4364 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047510 Oct 19 22:12:41.886971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 899/1806] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:42.632571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:42.634707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:42.641791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.642269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.642700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.643422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.643875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.644296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.673235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e041f74-172a-48f2-b631-b0d54cf98b8d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Oct 19 22:12:42.673807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 908/1807] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:42.850288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:42.852851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:42.853289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:42.856380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:42.860918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.860918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.860918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.861841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.862315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.862713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.864104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.865267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.866017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.868874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.869625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.870263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.896395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ce6e49df-0421-4198-9704-c6690fa637e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050033 Oct 19 22:12:42.897785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 900/1808] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:42.902747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:42.905027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:42.908862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01bfb1d8-3b18-4ad5-b8fd-3513f2f363d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061051 Oct 19 22:12:42.909619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 909/1809] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:42.921590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.921590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.921590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.921590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:42.922000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:42.922000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:42.943200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f24903e0-b618-4540-88db-fca439fa0e95 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044115 Oct 19 22:12:42.944259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 901/1810] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:43.686049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:43.688354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:43.694777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.695291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.695720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.696397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.696843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.697257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.725517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-04c9c526-bc1f-4fec-bfa9-f08baeeb0248 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Oct 19 22:12:43.726050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 910/1811] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:43.909526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:43.911765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:43.917761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.918450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.918869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.919591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.920037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.920456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.922263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:43.935698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:43.935698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.935698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.935698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.936283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.936943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.937547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.952092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-600f6b1e-7e2c-4fa6-a0f9-1bb310133772 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Oct 19 22:12:43.952813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 902/1812] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:43.961372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:43.963509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:43.969878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.970365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.970800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.970906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-587fa1d7-2bbc-4236-9457-8d5d2db0ed5c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053155 Oct 19 22:12:43.971520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:43.972173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:43.972390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:43.982398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 911/1813] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:44.001534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5ff32eba-a521-448d-b88b-de0df04cec53 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043799 Oct 19 22:12:44.002077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 903/1814] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:44.738157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:44.741803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:44.748641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:44.749125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:44.749560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:44.755366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:44.755854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:44.756298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:44.785044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c7851675-842b-4a31-8c1f-de274155611a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050878 Oct 19 22:12:44.785600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 912/1815] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:44.964242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:44.966359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:44.972609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:44.973083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:44.973513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:44.974198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:44.975177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:44.975596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:45.003307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:45.005784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:45.007146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-576d3303-4a2a-45f0-a48b-9f7d35770446 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046663 Oct 19 22:12:45.011389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 904/1816] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:45.013953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:45.014721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:45.015496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:45.016033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:45.016158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:45.016923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:45.017485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:45.018043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:45.023795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:45.023795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:45.023795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:45.024203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:45.024654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:45.025070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:45.050515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f1e2f207-cda4-4e0b-a948-4b4a8265bcc5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059768 Oct 19 22:12:45.051247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 913/1817] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:45.054980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0668c9b6-1d70-41db-91c8-a582fdbc4edc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044776 Oct 19 22:12:45.055538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 905/1818] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:45.797382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:45.799529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:45.806030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:45.806502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:45.806928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:45.807626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:45.808332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:45.808745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:45.836363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ed3a743f-2f1e-419c-82a3-493f17894537 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042915 Oct 19 22:12:45.836903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 914/1819] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:46.021615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:46.023752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:46.030030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.030509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.030942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.031642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.032090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.032517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.063153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-05a2ba1c-cf68-4f7f-8bb4-a43e97aea8d2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Oct 19 22:12:46.063724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 906/1820] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:46.064242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:46.067415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:46.068766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:46.070837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:46.073916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.074399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.074817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.075554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.076031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.076515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.076718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.076987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.077423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.078107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.078578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.079021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.108765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-193d58e9-c241-4320-be6a-21ac729fdbe5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049127 Oct 19 22:12:46.116672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9c6a1276-e94c-4816-8600-41b832c86746 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044094 Oct 19 22:12:46.116795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 915/1822] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:46.116898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 907/1822] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:46.848721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:46.851428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:46.857365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.857845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.858280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.858987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:46.859443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:46.859869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:46.888509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dcb6e52f-67ad-4658-9a80-18e95df186c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Oct 19 22:12:46.889050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 916/1823] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:47.075067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:47.077228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:47.083553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.084550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.084974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.085660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.086108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.086530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.118845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a1b2924-fe9c-4040-b507-b3c759e9eb3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Oct 19 22:12:47.118845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 908/1824] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:47.127311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:47.127852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:47.129443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:47.129567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:47.139839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.139949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.140045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.140139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.140232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.140318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.140404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.140481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.140556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.140652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.140737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.140845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.170069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0252071c-b487-4de4-89d9-def181c11a3e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046660 Oct 19 22:12:47.170643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 917/1825] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:47.170798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a6db516-6f92-4cf3-9251-145beca37369 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046871 Oct 19 22:12:47.171217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 909/1826] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:47.901793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:47.903943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:47.910032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.910511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.910944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.911719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:47.912812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:47.913239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:47.941614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5a8fe11c-a935-4042-858b-635efd3e65ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Oct 19 22:12:47.942087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 918/1827] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:48.129593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:48.131787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:48.138392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.138876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.139341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.140030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.140479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.140909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.170983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-285de2e1-8808-40d8-9032-501ccb63b74c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045122 Oct 19 22:12:48.171600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 910/1828] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:48.183672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:48.183854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:48.185808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:48.185933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:48.191907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.192326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.192761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.193498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.193796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.193932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.194360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.194753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.195348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.196174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.196768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.197193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.227280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6482061d-6944-4923-98a5-96b87b6dbaee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047433 Oct 19 22:12:48.227840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 911/1829] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:48.228238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b74266e8-7737-47a1-9a6e-d78ab6dc5f29 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048458 Oct 19 22:12:48.228792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 919/1830] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:48.953701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:48.955836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:48.962359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.962831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.963298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.963975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:48.964421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:48.964834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:48.993593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d6bc05a6-12ed-46f1-8a0a-66a657aa779c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Oct 19 22:12:48.994130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 912/1831] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:49.183191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:49.185221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:49.191709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:49.192219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:49.192659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:49.193406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:49.194382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:49.194807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:49.223758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-89151578-4da7-4c4b-8af0-b5a8fb411b63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Oct 19 22:12:49.224471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 920/1832] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:49.239978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:49.240997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:49.243200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:49.243370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:49.249339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:49.249730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:49.249852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:49.250197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:49.250314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:49.250784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:49.250918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:49.251391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:49.251832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:49.252152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:49.252753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:49.253321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:49.283906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4de1adf3-9498-4500-a2c5-312650904319 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047402 Oct 19 22:12:49.284492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e01a3cda-f854-4307-ae06-16571bd37e3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048745 Oct 19 22:12:49.284663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 921/1833] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:12:49.285038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 913/1834] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:50.006498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:50.008662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:50.014672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.015191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.015632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.016318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.016773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.017197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.047364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-16e72b50-2ee3-4a05-b0a0-d04d80bf89c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045263 Oct 19 22:12:50.047896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 922/1835] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:50.235427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:50.237598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:50.244154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.244751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.245043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.246048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.246148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.246563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.264326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:50.281171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f7c0abb5-298a-4389-864d-9d4a3b66dcf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046617 Oct 19 22:12:50.281171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 914/1836] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:50.300448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:50.301812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:50.302159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:50.304033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:50.308839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.309614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.310055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.310590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.310781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.311198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.311320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.311639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.311761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.312207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:50.312653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:50.313071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:50.342775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b15aeb4-16ea-4269-943c-7e31ee8b82ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049695 Oct 19 22:12:50.343370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 923/1837] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:50.351996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fc7ae40e-aa4f-487b-8c0b-7825b169097a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054315 Oct 19 22:12:50.352565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 915/1838] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:51.060339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:51.062465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:51.068811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.069286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.069744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.070433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.070883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.071374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.087948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:51.100765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6aca5edf-c123-4314-9cbb-80ac70bf5f97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Oct 19 22:12:51.101309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 924/1839] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:51.290626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:51.292705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:51.299033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.299518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.299954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.300647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.301099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.301523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.332138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ffe147e-a406-4a5b-a9d5-e9bb4419c22c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 Oct 19 22:12:51.332701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 916/1840] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:51.355398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:51.357952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:51.364219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:51.367075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:51.367230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.367657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.368099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.368919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.369383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.369812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.373054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.373538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.373992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.374674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:51.375136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:51.375557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:51.402076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-329e952a-8ed3-4dad-85bd-c6eb0e6b9312 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050721 Oct 19 22:12:51.402641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 925/1841] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:51.409410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b34a0ac1-3bb1-4eea-999a-1a7f5128a68a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049007 Oct 19 22:12:51.409965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 917/1842] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:52.112643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:52.114777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:52.121353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.121834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.122272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.122974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.123432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.123855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.152562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7bacd02-6189-4a0a-8eac-75c7d6715e3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Oct 19 22:12:52.153117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 926/1843] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:52.345533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:52.347640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:52.354739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.355251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.355679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.356359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.356805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.357225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.387589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-59af1340-70fc-42f8-a40a-13eab8a585a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Oct 19 22:12:52.388339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 918/1844] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:52.414036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:52.416780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:52.421777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:52.423169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.423659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.424092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.424498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:52.424790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.425243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.425665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.430837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.431350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.431836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.432475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:52.433175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:52.433595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:52.459613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-327cc75e-fc8e-4516-bddd-abf8a2acbfe8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 Oct 19 22:12:52.459613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 927/1845] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:52.468131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-53c1d8e2-51aa-435b-87a3-a6dbff3e0a51 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050362 Oct 19 22:12:52.468701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 919/1846] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:53.164957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:53.167174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:53.173223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.173699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.174132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.174817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.175355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.175776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.204940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-64f65d28-649f-41ce-901d-39cf0397d2c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Oct 19 22:12:53.205487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 928/1847] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:53.400607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:53.402776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:53.409181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.409665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.410103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.410795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.411279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.411708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.440897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1dece65d-594b-4048-ac3e-9adf08226233 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Oct 19 22:12:53.441821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 920/1848] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:53.471402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:53.474358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:53.481048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.481667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:53.481806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.482189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.482880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.483361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.483784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.484007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:53.490032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.490557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.491026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.491728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:53.492176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:53.492607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:53.514315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3889942-b66a-419a-a971-0ebe9af150d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046940 Oct 19 22:12:53.515218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 929/1849] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:53.523854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5886084a-d0c5-427a-8929-377eb8ff641a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046042 Oct 19 22:12:53.524411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 921/1850] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:12:54.217850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:54.220020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:54.226454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.226943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.227415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.228111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.228565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.228996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.257791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9240aa06-98b7-4349-b955-87a14c7ea9de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Oct 19 22:12:54.258350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 930/1851] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:54.453751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:54.455932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:54.462744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.463265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.468221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.468221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.468221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.468221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.495451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9a1a3b06-ffe0-49d4-bdf4-0b135b831166 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045620 Oct 19 22:12:54.496008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 922/1852] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:54.526926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:54.529239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:54.536813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:54.537962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.538456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.539553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.539672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:54.540265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.540726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.541481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.545691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.546235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.546673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.547394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:54.547997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:54.548410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:54.572147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ec894d8a-6514-4683-b546-06882dd977b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049624 Oct 19 22:12:54.572714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 931/1853] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:54.579419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-43df6bb1-8e3d-4056-a94d-33afe09374c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046737 Oct 19 22:12:54.580061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 923/1854] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:55.270344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:55.272648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:55.279105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.279584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.280017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.280700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.281150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.281574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.310831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ebb03ffd-020c-42de-a9a4-06855ac677aa tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Oct 19 22:12:55.311397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 932/1855] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:55.507853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:55.509980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:55.516351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.516834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.517270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.517959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.518414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.518842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.548214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-90755807-bc1f-4da0-bd9e-350ca4f38209 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Oct 19 22:12:55.548767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 924/1856] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:55.584818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:55.587102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:55.592161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:55.593982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:55.595572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.596056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.596397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:55.596515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.597199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.597650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.598236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.603656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.603993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.604382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.605287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:55.605745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:55.606340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:55.629926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa81381d-bacc-4391-a9f1-4bbf0a139a74 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049433 Oct 19 22:12:55.630646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 933/1857] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:55.641096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3be9857a-d5ee-416d-bdb8-49279570322e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053082 Oct 19 22:12:55.641647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 925/1858] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:56.324097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:56.325916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:56.332316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.332798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.333226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.333917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.334362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.334780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.363905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-66f10cba-6344-46ef-97c2-a20fdf422db5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Oct 19 22:12:56.364456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 934/1859] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:56.561317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:56.563472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:56.570808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.571314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.571747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.572439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.572896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.573321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.602377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa0e9519-05ef-483a-b184-940a98c1c4f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Oct 19 22:12:56.602941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 926/1860] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:56.642379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:56.644527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:56.652933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.653421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.653538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:56.653857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.654554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.655034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.655461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.655991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:56.661908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.662398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.662830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.664296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:56.664749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:56.665308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:56.687743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d194efe2-4e66-4189-a5cd-4bee9e8e13a9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049595 Oct 19 22:12:56.690986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 935/1861] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:56.695223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b824cce9-1f0d-45be-9953-c5c6c65105a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045917 Oct 19 22:12:56.695767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 927/1862] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:57.377031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:57.379266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:57.385789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.386266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.386696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.387400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.387849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.388269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.417865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7014da94-8c5f-4d61-9417-1413cf3eb188 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Oct 19 22:12:57.418416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 936/1863] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:57.614662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:57.616790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:57.623188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.623702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.624140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.624830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.625288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.625713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.654592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4693e705-ac87-475d-b9c9-d3591c82db85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Oct 19 22:12:57.655175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 928/1864] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:57.701264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:57.704877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:57.709803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.710112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:57.710292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.711435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.712125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.712580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.712914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:57.713056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.719067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.719495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.720063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.720761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:57.721341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:57.721766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:57.747529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa51d9c2-ba35-4b44-b851-a501b1f565b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050758 Oct 19 22:12:57.751672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 937/1865] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:57.756413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-80553e77-77b7-42d5-b34a-5123c3e9548b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050348 Oct 19 22:12:57.756969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 929/1866] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:58.430706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:58.432842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:58.439107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.439593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.440031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.440720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.441174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.441601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.472161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-86252fcd-a286-423e-9b9b-6cee5b497efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Oct 19 22:12:58.472727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 938/1867] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:58.666465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:58.668661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:58.675103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.675577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.676004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.676677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.677122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.677536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.706273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fa0401c5-3a03-471a-94ce-a8eb6f0bcf92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Oct 19 22:12:58.706814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 930/1868] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:58.760525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:58.762982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:58.769471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:58.770281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.770773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.771231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.771868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:58.771993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.772375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.772824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.775332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:58.779208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.779526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.779969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.780645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:58.781211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:58.781712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:58.786989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:58.816732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4f8bf964-ce09-413a-b2ee-1d0f1f4e9782 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060900 Oct 19 22:12:58.817192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b59e1eba-3573-49dc-9a9c-e0f2f7ebacf5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051351 Oct 19 22:12:58.817638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 939/1869] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:58.818124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 931/1870] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:12:59.484600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:59.486726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:59.492713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.493193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.493623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.494313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.494764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.495224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.524274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1c2cf508-182b-4918-b9c8-f3cb8a41c3a0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Oct 19 22:12:59.524816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 940/1871] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:59.719105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:59.721247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:59.728373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.728842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.729267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.729952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.730396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.730814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.759953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-df315564-92f7-4462-8d6c-f6e0fcf7f455 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 Oct 19 22:12:59.760433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 932/1872] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:59.828901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:59.829678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:12:59.831051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:59.831998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:12:59.837927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.838423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.838835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.839562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.839821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.840010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.840427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.840591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.841023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.841813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:12:59.842238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:12:59.842668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:12:59.845196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:12:59.872009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0f0c3ba4-d9c6-4b81-82df-76e23cea8850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Oct 19 22:12:59.872009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 941/1873] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:12:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:12:59.883054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0409e409-a32b-42c9-bd0d-104fa608c97d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057160 Oct 19 22:12:59.883605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 933/1874] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:12:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:00.536221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:00.538414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:00.544465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.544936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.545364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.546039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.546487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.546903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.575800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b4ba211f-5431-4cf2-b364-ebd9df38513d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Oct 19 22:13:00.576337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 942/1875] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:00.772109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:00.774901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:00.781381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.781865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.782304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.783024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.783488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.783917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.813375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0f8dae91-5deb-472b-bc75-d24b9d94d91e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Oct 19 22:13:00.813924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 934/1876] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:00.884122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:00.886237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:00.893149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.893642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.894079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.894780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.895267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.895698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.895882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:00.898598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:00.904610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.905093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.905554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.906423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:00.906685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:00.907137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:00.926792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1891e894-ab78-4ba4-bab6-2de45824b8a8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046976 Oct 19 22:13:00.931410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 943/1877] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:00.936669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-96292850-46ef-42e5-9bf1-cd4ecd747a9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045058 Oct 19 22:13:00.937215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 935/1878] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:01.588930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:01.591104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:01.597426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.597912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.598352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.599112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.599568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.600024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.628495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-10571ff5-d525-4df4-a9cf-f018aae8bd81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Oct 19 22:13:01.629058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 944/1879] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:01.825821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:01.828007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:01.834307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.834780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.835732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.836441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.836887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.837304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.866392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9f5e98e2-17a2-40d1-9897-a534111fd1b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Oct 19 22:13:01.866866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 936/1880] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:01.939411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:01.941456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:01.948121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.948603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.949036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.949728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.950179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.950354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:01.950599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.952938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:01.959884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.961613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.962044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.962742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:01.963214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:01.963638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:01.983164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b1a244f3-b38b-4a1f-811d-fe63970f5103 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Oct 19 22:13:01.983164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 945/1881] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:01.994301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-905fabfd-8727-4a2c-acb0-1baf8ea23749 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047831 Oct 19 22:13:01.994836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 937/1882] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:02.641633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:02.643729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:02.650183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:02.650656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:02.651119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:02.651802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:02.652250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:02.652668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:02.681158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fe1aaae3-0997-4e7d-9402-30aa9cf37870 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Oct 19 22:13:02.681703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 946/1883] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:02.878810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:02.880956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:02.887891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:02.888363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:02.888793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:02.889469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:02.889918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:02.890335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:02.919787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3005fbd4-e52e-4711-b875-f293e7eab449 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Oct 19 22:13:02.920257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 938/1884] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:02.993977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:02.996165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:03.004322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.004814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.005250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.005958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.006147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:03.006412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.006839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.008968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:03.014997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.015484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.015920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.016614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.017092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.017477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.039444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b7b059aa-db37-42b8-9078-fdb1fad4294f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049373 Oct 19 22:13:03.044180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 947/1885] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:03.048367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4b58b605-3d7f-43d6-a0b2-188a02b24a01 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046289 Oct 19 22:13:03.048915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 939/1886] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:03.693889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:03.696552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:03.702974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.703459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.703892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.704569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.705020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.705440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.733644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-db4b5dce-6075-48cb-9082-c23a16757a5a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Oct 19 22:13:03.734184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 948/1887] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:03.931427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:03.933854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:03.940109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.940579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.941009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.941688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:03.942136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:03.942560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:03.971854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-01938720-7109-4bf0-b305-329562d52e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Oct 19 22:13:03.972387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 940/1888] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:04.051664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:04.053788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:04.060527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.061019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.061453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:04.061589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:04.062149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.062597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.063041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:04.063728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:04.069683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.070187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.070620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:04.071342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.071786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.072394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:04.104950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0624fd8e-65be-4f6f-b2f8-6f64721d55dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047589 Oct 19 22:13:04.105762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 941/1889] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:04.109834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-628c1893-3b2b-45d2-b524-ca232bac6613 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061417 Oct 19 22:13:04.109834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 949/1890] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:04.745755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:04.747934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:04.754303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.754787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.755264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:04.755961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.756417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.756844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:04.786541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-26d2b175-2f62-4749-a38a-38f01658adee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Oct 19 22:13:04.787133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 950/1891] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:04.984617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:04.986737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:04.993624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.994100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.994530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:04.995234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:04.995685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:04.996150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:05.025208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fe0816cf-bbee-4f01-9c04-160489760391 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Oct 19 22:13:05.025740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 942/1892] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:05.117598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:05.119866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:05.121521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:05.123826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:05.125942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:05.126436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:05.126878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:05.127607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:05.128068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:05.128497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:05.130766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:05.131283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:05.133081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:05.133081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:05.133484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:05.134192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:05.159323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7b48954a-d022-4882-a03f-ce74f684cae6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045721 Oct 19 22:13:05.159899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 951/1893] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:05.165142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c4195ce2-0027-42e9-9927-f18f689f000e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047103 Oct 19 22:13:05.165690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 943/1894] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:05.798968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:05.801078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:05.808345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:05.808819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:05.809248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:05.809922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:05.810368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:05.810785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:05.839917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-254ea458-be9a-47b1-96ef-971262fc4632 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Oct 19 22:13:05.840461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 952/1895] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:06.037768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:06.040524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:06.046869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.047384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.047824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.048516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.048971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.049399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.078972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c468d82f-57fd-4b81-ab89-e584afa571e5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Oct 19 22:13:06.079536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 944/1896] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:06.172282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:06.174428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:06.177987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:06.180782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:06.182252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.182999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.183907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.184615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.185070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.185676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.187088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.187574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.188011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.188700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.189156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.189579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.214833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-21ffbb83-6309-4c7f-b455-eb8a8f12861d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046995 Oct 19 22:13:06.215417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 953/1897] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:06.223127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a2edff1-83df-4558-a84a-e66233c09b14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049008 Oct 19 22:13:06.223673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 945/1898] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:06.852819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:06.854930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:06.861464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.861936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.862363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.863110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:06.863558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:06.863987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:06.893648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-007677e8-d751-42d1-9ae2-0cafd2d5cbf7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Oct 19 22:13:06.894203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 954/1899] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:07.091535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:07.093608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:07.100003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.100489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.100928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.101628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.102081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.102508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.131419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4c0dea2d-62ec-4ec6-88a8-5f7db2349463 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Oct 19 22:13:07.131968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 946/1900] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:07.227198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:07.229350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:07.235735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:07.236365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.236857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.237353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.238050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.238327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:07.238499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.238920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.245056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.245632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.246095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.252601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.252601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.252601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.270241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-320d45a1-36c3-479c-9a92-73bfb3d8ecd8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047130 Oct 19 22:13:07.270806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 955/1901] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:07.273366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:07.279245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c3db3d51-401d-4c68-bfee-9518eecf78e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Oct 19 22:13:07.279791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 947/1902] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:07.906591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:07.908793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:07.915160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.915644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.916677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.917354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:07.917800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:07.918218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:07.946847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c79daedc-9b96-4356-b109-12f74a0ac6c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Oct 19 22:13:07.947466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 956/1903] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:08.144590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:08.146671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:08.153978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.154456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.154886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.155599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.156053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.156478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.186185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-92d80cef-3637-4294-8b0c-8e1458e7d1c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Oct 19 22:13:08.186737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 948/1904] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:08.283252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:08.285478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:08.291601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.292089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.292531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.293228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.293684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.294109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.295484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:08.297666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:08.304109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.304769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.305213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.305909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.306437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.306867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.325178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:08.329901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-267c71d1-aebe-43fa-b572-b45141cb8a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050637 Oct 19 22:13:08.330475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 957/1905] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:08.336646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b51ceee8-c74f-4adf-94c1-fa81178a3e2c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Oct 19 22:13:08.339348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 949/1906] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:08.959580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:08.961691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:08.968705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.969178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.969609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.970290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:08.970740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:08.971184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:08.998710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8c8c9f23-3281-4558-b6dc-ecd0c988ba0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Oct 19 22:13:08.999276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 958/1907] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:09.199790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:09.202040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:09.208591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:09.209075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:09.209509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:09.210276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:09.210678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:09.211138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:09.239900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a315f397-b5a7-4fb1-9966-ba4b86f75910 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Oct 19 22:13:09.240444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 950/1908] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:09.341509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:09.344831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:09.350297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:09.350782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:09.351252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:09.351472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:09.351952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:09.352402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:09.352823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:09.354213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:09.364223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:09.364223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:09.364223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:09.364223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:09.364746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:09.364746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:09.382936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e22eae66-8bf3-4b0f-835a-e61cd376d14f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045237 Oct 19 22:13:09.383565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 959/1909] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:09.393542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bdffff6c-0f04-4861-a758-3161985419a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047439 Oct 19 22:13:09.394088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 951/1910] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:10.011469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:10.013574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:10.019880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.020356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.020788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.021467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.021921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.022339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.052510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ee904d8e-91ba-4df9-9c19-a55934e73f10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Oct 19 22:13:10.053069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 960/1911] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:10.252796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:10.254933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:10.262135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.262552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.263007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.263700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.264156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.264581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.296128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-608b9c55-342b-4b0d-9d33-25324ab2d22a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Oct 19 22:13:10.296690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 952/1912] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:10.400043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:10.402986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:10.406989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:10.409011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.409502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.409870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:10.409991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.410627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.411111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.411541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.416305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.416863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.417372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.418150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:10.418672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:10.419202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:10.442016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e87d3a57-74ac-4152-8f0a-b80ff7a3e5e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045955 Oct 19 22:13:10.442579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 961/1913] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:10.449570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-39d1d646-880b-4814-90ed-8c9e8de08cf7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047266 Oct 19 22:13:10.450138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 953/1914] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:11.065756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:11.067824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:11.074781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.075287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.075726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.076397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.076843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.077260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.106446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c1977e99-08ec-408a-b374-18966561e3e2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Oct 19 22:13:11.107009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 962/1915] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:11.308945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:11.311096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:11.317479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.317899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.318337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.319048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.319507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.319930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.349265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eaf79b6f-7412-44af-bf25-925bb73722ad tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Oct 19 22:13:11.349814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 954/1916] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:11.455429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:11.457808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:11.462560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:11.464509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.465001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.465358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:11.465468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.466274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.466737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.467210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.471392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.472091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.472526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.473224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:11.473680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:11.474400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:11.498922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-db4d13e3-ecff-4c6b-9e94-2d301b2ad324 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047631 Oct 19 22:13:11.499521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 963/1917] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:11.504665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9996b1cb-13f1-47f5-add5-27d3a4d0443f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047028 Oct 19 22:13:11.505213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 955/1918] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:12.119511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:12.121669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:12.128119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.128684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.129039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.129730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.130190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.130614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.159038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-729b6d7f-7331-4441-a468-e052346fc0bd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 Oct 19 22:13:12.159546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 964/1919] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:12.361339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:12.363495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:12.369852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.370328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.370760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.371483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.371936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.372357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.408102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3cf0cac8-9944-4f04-a5d1-4f5065008941 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050639 Oct 19 22:13:12.408653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 956/1920] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:12.512270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:12.515170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:12.516545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:12.518684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:12.523109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.523822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.524445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.525443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.526095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.526212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.526646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.527099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.527212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.527998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:12.528465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:12.529612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:12.561298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-88f4b6af-c47d-478f-8acc-9cbbc6a6c85c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053684 Oct 19 22:13:12.563004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 965/1921] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:12.563341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0fbbb1e4-933c-4ce3-ae73-cb77cf924e09 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050495 Oct 19 22:13:12.563910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 957/1922] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:13.171225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:13.173418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:13.180177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.180653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.181098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.182588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.183074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.184346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.213699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-107bc20f-9d35-4817-8158-cb8bf0b64f6e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Oct 19 22:13:13.214251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 966/1923] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:13.446335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:13.446335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:13.446335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.446335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.447852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.447852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.447852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.447852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.467120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b092efe5-c060-4009-a8b1-6765d1a1429c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049400 Oct 19 22:13:13.467696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 958/1924] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:13.574575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:13.576313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:13.576725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:13.578416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:13.582657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.583082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.583512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.584471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.584926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.585130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.585346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.585623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.586059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.586762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:13.587246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:13.588241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:13.616199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-063f142e-5e52-4f55-9957-3e9d890a1a36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046541 Oct 19 22:13:13.617178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 967/1925] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:13.617585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f624915-eb52-4739-bee7-3cbdc323c7b8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Oct 19 22:13:13.618139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 959/1926] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:14.226115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:14.228330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:14.234797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.235307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.235746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.236429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.236880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.237303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.265540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a2fa237f-dea1-4e49-a81f-c7d491244457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Oct 19 22:13:14.266086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 968/1927] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:14.478792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:14.480938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:14.487256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.487738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.488170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.488857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.489322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.489743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.519746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-01783eaa-59d7-4112-ad50-e5891f475740 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Oct 19 22:13:14.520298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 960/1928] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:14.629523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:14.632909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:14.635182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:14.637861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:14.639576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.640060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.640687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.641394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.641848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.642274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.644326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.644807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.645240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.645935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:14.646385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:14.646798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:14.672923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-adab16ac-fc55-4db9-85ef-6af4cc121e32 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047250 Oct 19 22:13:14.673570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 961/1929] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:14.677109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b8ebc703-a016-4984-824a-4792d5be4e30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046448 Oct 19 22:13:14.677659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 969/1930] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:15.277701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:15.279862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:15.285946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.286426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.286861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.287574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.288205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.288636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.317331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d690c517-1138-4235-838c-74121397ac63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 Oct 19 22:13:15.317798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 962/1931] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:15.532223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:15.534392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:15.541484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.541966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.542399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.543115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.543570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.543993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.572773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6654ab96-51ca-4f28-8753-f782378dc80a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Oct 19 22:13:15.573254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 970/1932] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:15.685613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:15.687992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:15.690164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:15.692612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:15.694515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.695027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.695458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.696359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.697556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.698011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.700199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.700695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.701128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.702132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:15.702593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:15.703039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:15.731410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2dc2e27e-d758-4715-9660-7fe09fef2d71 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049992 Oct 19 22:13:15.731978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 963/1933] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:15.733937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d8847a6f-b52d-47d5-840d-b57e2438f87b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048217 Oct 19 22:13:15.734794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 971/1934] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:16.329480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:16.331628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:16.337395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.337867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.338300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.338987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.339440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.339856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.355916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:16.367723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8439bdbe-5aa1-4e15-a846-7916bc07b3c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042106 Oct 19 22:13:16.370272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 964/1935] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:16.585120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:16.587294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:16.593707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.594181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.594609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.595320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.595768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.596186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.625547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-93957e50-65fd-4ef3-b527-de0fd6ed9720 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Oct 19 22:13:16.626022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 972/1936] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:16.748332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:16.748949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:16.750469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:16.750687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:16.756447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.757147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.757589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.757717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.758225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.758357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.758656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.758774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.759197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.759963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:16.760425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:16.760849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:16.790481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fcb3c94c-9f4d-4b75-b00d-f569946107b6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046443 Oct 19 22:13:16.796402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 965/1937] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:16.800844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a8b30df8-8e86-4bae-8e9d-2abed9d2f893 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056836 Oct 19 22:13:16.801433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 973/1938] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:17.380914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:17.383083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:17.389587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.390068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.390500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.391228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.391681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.392101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.420838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6c192904-aec3-432b-b7c4-27cf233069f5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Oct 19 22:13:17.421385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 966/1939] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:17.638498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:17.640655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:17.647046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.647529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.647966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.648655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.649107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.649531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.665748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:17.678579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-96763ad2-5489-4b0e-a6b4-b8ffa889bc30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Oct 19 22:13:17.679153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 974/1940] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:17.803233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:17.805351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:17.811772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.812252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.812679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.813366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.813996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.814450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.815943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:17.818250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:17.824658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.825145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.825941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.827018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:17.827487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:17.827907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:17.846481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f8f63aa8-69fc-4379-b5d6-95aafed447ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047243 Oct 19 22:13:17.847161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 967/1941] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:17.858114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d00f3878-30df-4b20-af70-92bec909b9fe tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048199 Oct 19 22:13:17.858667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 975/1942] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:18.433977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:18.436223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:18.442106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.442591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.443054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.443838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.444300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.444722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.474649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b9abee5d-ebec-4939-9394-788538e284e0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Oct 19 22:13:18.475232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 968/1943] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:18.691931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:18.694005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:18.700916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.701398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.701837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.702527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.703000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.703428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.732632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e77976a4-8810-4c76-8f77-7036f9bc92c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Oct 19 22:13:18.733184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 976/1944] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:18.859910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:18.862177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:18.869171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.869502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:18.869963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.870244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.870943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.871419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.871899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.872380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:18.879238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.880758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.880758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.880938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:18.881476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:18.882248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:18.907889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5d8841d4-cd39-4702-85e2-c3333def4522 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052177 Oct 19 22:13:18.908737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 969/1945] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:18.921795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-47708881-263a-4745-9ccf-637025282462 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056120 Oct 19 22:13:18.922345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 977/1946] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:19.487965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:19.490131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:19.496828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.497308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.497770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.498463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.498916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.499366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.527198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-955b6365-55d8-4a74-913e-9cf60542f4d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043165 Oct 19 22:13:19.527741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 970/1947] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:19.745475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:19.747574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:19.753916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.754396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.754832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.755548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.755998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.756419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.785324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f87c6ad8-4bde-4322-bf15-194445762bcc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Oct 19 22:13:19.786017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 978/1948] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:19.920765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:19.922871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:19.929379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.929864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.930280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.930995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.931955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.932375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.934793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:19.937956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:19.943797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.944282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.944794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.945504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:19.945962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:19.946421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:19.970600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-58f8f871-fb72-4b1e-9067-a0c4c4e5c0cc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053806 Oct 19 22:13:19.971181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 971/1949] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:19.976370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c81c7e0d-7e2a-411b-ac97-154e3582f06d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046524 Oct 19 22:13:19.976927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 979/1950] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:20.539842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:20.542633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:20.548471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:20.548943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:20.549376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:20.550052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:20.550497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:20.550912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:20.580250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-12ea39cd-c43e-4d60-aa5e-f6de59582275 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Oct 19 22:13:20.580781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 972/1951] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:20.797659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:20.799842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:20.806801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:20.807326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:20.807785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:20.808725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:20.809173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:20.809589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:20.838774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6468617b-0481-4973-be75-f0210fe4baf1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Oct 19 22:13:20.839354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 980/1952] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:20.985759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:20.987925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:20.989278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:20.991965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:20.995020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:20.995695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:20.996306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:20.997154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:20.997755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:20.998326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:20.998586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:20.999098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:20.999825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:21.000535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:21.001002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:21.001429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:21.028773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3cf7b5bb-716c-48d0-aa84-36bfb590550e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 Oct 19 22:13:21.029382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 973/1953] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:21.032409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4a3f03c-60c5-47ee-9eb7-90c5ebe975e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047111 Oct 19 22:13:21.032975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 981/1954] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:21.592093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:21.594224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:21.600154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:21.600639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:21.601063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:21.601750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:21.602198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:21.602621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:21.631356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ea6505b2-d930-44f6-9c06-0d015276b2cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043027 Oct 19 22:13:21.631880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 974/1955] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:21.851357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:21.853943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:21.860522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:21.861004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:21.861441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:21.862131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:21.862589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:21.863043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:21.895458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-26b54525-646a-4d12-9a6c-af8b22735d35 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048111 Oct 19 22:13:21.896022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 982/1956] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:22.042165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:22.044981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:22.050187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:22.051125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.051618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.052123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.052334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:22.052746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.053204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.053631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.054347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:22.060996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.061585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.061929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.062654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.063160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.064242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.094640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8694db8c-5f08-4f52-8c47-676cf80bcde7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057417 Oct 19 22:13:22.095262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 975/1957] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:22.096476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0c80b037-f0de-4128-8be9-33161daf0af6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050103 Oct 19 22:13:22.097070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 983/1958] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:22.645405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:22.647478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:22.653913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.654385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.654817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.655531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.655985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.656401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.684381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a92219a5-a2c8-43c0-a14a-92e2365859cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042957 Oct 19 22:13:22.684907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 976/1959] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:22.907931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:22.910038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:22.916500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.916980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.917412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.918098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:22.918550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:22.918990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:22.953129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-96db246c-19fe-43af-81e7-33920b44bbf2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049199 Oct 19 22:13:22.953687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 984/1960] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:23.107203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:23.108609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:23.109684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:23.111471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:23.117079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.117582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.117964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.118184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:23.118442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.119484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.119590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:23.120000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.120350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.120627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:23.120808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.121229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:23.152629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa808ec3-c4b3-4f11-bc2f-bd77b66f07c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049279 Oct 19 22:13:23.153154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-394d369a-8191-4f45-a3e5-2400531aa399 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048401 Oct 19 22:13:23.153307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 977/1961] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:23.153801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 985/1962] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:23.696575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:23.698755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:23.705347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.705837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.706275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:23.706973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.707449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.707875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:23.736937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1bfc1f18-3ba1-47f5-861d-c572e55aaaa1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Oct 19 22:13:23.737476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 978/1963] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:23.966022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:23.968214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:23.974552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.975070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.975501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:23.976184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:23.976647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:23.977056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:24.005072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c9ca30e6-98c1-45fc-bdd9-a9117fd0a60a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Oct 19 22:13:24.005617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 986/1964] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:24.166350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:24.167840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:24.168508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:24.169976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:24.174585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:24.175231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:24.175534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:24.185545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:24.185804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:24.185895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:24.185984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:24.186066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:24.186151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:24.186241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:24.186241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:24.186241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:24.207432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6f8d482b-8dc3-4acf-8c52-ed065ef86100 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046137 Oct 19 22:13:24.208454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 979/1965] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:24.208859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-611a92b7-ce60-42b2-9a37-77a96a52dd6a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Oct 19 22:13:24.209545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 987/1966] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:24.749482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:24.751663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:24.757519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:24.757997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:24.758432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:24.759152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:24.759602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:24.760022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:24.787836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7ba306d4-4e3b-4598-9179-992ce741399a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Oct 19 22:13:24.788579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 980/1967] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:25.017815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:25.019951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:25.026937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.027513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.027944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.028647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.029093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.029508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.059082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e1272ec7-f051-464a-bc17-6e90c66d1782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Oct 19 22:13:25.059628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 988/1968] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:25.220343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:25.222095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:25.222595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:25.224481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:25.225858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:25.229889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.230364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.230795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.231520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.231751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.231962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.232382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.232554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.233075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.233835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.234444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.235115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.247910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:25.265863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fecfc978-d532-44ff-b881-44a9d7a4c92e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050067 Oct 19 22:13:25.266418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 981/1969] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:25.273301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9e8eb67f-f172-48bb-ace7-8f09b8ddbcbb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055483 Oct 19 22:13:25.273797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 989/1970] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:25.800592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:25.802728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:25.808992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.809464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.809892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.810562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:25.811031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:25.811453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:25.839162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-35c97e54-c0f9-4e03-8b71-a0b1f2a2e163 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 Oct 19 22:13:25.839728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 982/1971] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:26.072204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:26.074384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:26.080795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.081274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.081706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.082396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.082880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.083327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.112392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c2a55744-e0a1-4e03-b435-4b4eddcc1e4f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Oct 19 22:13:26.112943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 990/1972] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:26.279211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:26.282024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:26.285595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:26.287887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:26.288340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.288816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.289537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.289980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.291101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.291522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.294736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.295246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.295680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.296376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.296827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.297245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.301907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:26.323982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dcebfe22-af1a-476b-8ae5-3efa8a4584d9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050045 Oct 19 22:13:26.327852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 983/1973] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:26.328494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6901df03-822e-42f9-a0ef-f7b02b9c23f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046789 Oct 19 22:13:26.329100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 991/1974] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:26.851372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:26.854138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:26.860033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.860511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.860940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.861617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:26.862063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:26.862482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:26.890685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-be187b8f-2aa5-4e53-913b-75538e898488 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Oct 19 22:13:26.891258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 984/1975] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:27.125424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:27.127554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:27.134622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.139900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.139900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.139900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.139900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.140286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.166599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5158c8fe-f5d9-43e5-8a6f-4c5e89e33aa7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Oct 19 22:13:27.167187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 992/1976] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:27.337641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:27.339803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:27.340540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:27.342789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:27.346547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.347060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.347668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.348524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.349084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.349200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.349386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.349510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.349928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.350617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.351247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.351668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.382341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b71d92b2-7288-43d2-9fb2-aac06b07225d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048506 Oct 19 22:13:27.382815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 985/1977] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:27.383815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-310f7ac6-f6b8-417b-b7ae-b2e6abe20bd5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Oct 19 22:13:27.385022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 993/1978] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:27.903337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:27.905485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:27.911439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.911921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.912357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.913044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:27.913498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:27.913940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:27.943124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dbf4b9e5-7ea4-42dc-a741-8ec73c8fad04 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Oct 19 22:13:27.943665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 986/1979] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:28.179225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:28.181875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:28.188525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.189000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.189435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.190117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.190567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.191006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.220219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5f2d19c1-f29e-48c3-b747-66d56252c84e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Oct 19 22:13:28.220770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 994/1980] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:28.394893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:28.396612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:28.397504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:28.398721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:28.404574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.405063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.405201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.406079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.406302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.407081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.407215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.407303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.407508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.407677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.407898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.408316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.442128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3db06045-9bb9-4b72-8170-bccceb37c230 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051199 Oct 19 22:13:28.445226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f12602c5-5492-40a0-aff1-ff46d1fb4eaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052440 Oct 19 22:13:28.445826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 995/1981] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:28.448133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 987/1982] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:28.955486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:28.957628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:28.963681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.964164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.964604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.965294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:28.965746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:28.966180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:28.995080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3356d7e9-95a7-48c3-aa63-8d5779f0dd72 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Oct 19 22:13:28.995628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 996/1983] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:29.233077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:29.235226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:29.241082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:29.241561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:29.241996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:29.242677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:29.243159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:29.244213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:29.272350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c172c5d-954b-4fef-a65a-b7f76013c4f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043224 Oct 19 22:13:29.272897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 988/1984] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:29.457396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:29.459568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:29.459904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:29.462119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:29.466022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:29.466688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:29.467638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:29.468353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:29.468597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:29.468827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:29.469077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:29.469216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:29.469511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:29.470197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:29.470647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:29.471090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:29.501115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a6e66314-b8a4-4f71-a3a8-6b6c98d32aa7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045259 Oct 19 22:13:29.501351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-655742dd-25af-4543-9e92-52eb671a673f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047802 Oct 19 22:13:29.501669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 989/1985] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:29.501789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 997/1986] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:30.007100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:30.009682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:30.015586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.016063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.016496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.017181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.017630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.018052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.047357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b5ad9fcd-aa3a-47bf-bdb6-c0c0a30d213c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Oct 19 22:13:30.047905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 990/1987] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:30.284063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:30.286103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:30.292072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.292544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.292975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.293656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.294105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.294523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.324455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-95649336-f44b-4597-ac65-2c2564c198fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Oct 19 22:13:30.325011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 998/1988] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:30.513318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:30.513858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:30.515557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:30.516073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:30.522188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.522363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.522676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.522826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.523136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.523285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.523962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.524215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:30.524408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.524671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:30.525062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.525263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:30.554325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e128d74f-2c8d-4bb0-b282-918c53df3239 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045474 Oct 19 22:13:30.554839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ba560535-0d79-4488-8b9d-682edf604147 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Oct 19 22:13:30.555032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 991/1989] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:30.555599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 999/1990] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:31.060033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:31.062189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:31.068112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.068601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.069042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.069730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.070184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.070610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.099128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bf8b0b07-d078-4e2e-94ac-f29f00f6cf5c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043362 Oct 19 22:13:31.099685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 992/1991] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:31.336875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:31.338940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:31.344898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.345380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.345814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.346497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.347004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.347429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.376600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3423095e-742e-499a-a741-33c0b03e25bd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Oct 19 22:13:31.377147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1000/1992] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:31.567573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:31.569078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:31.569968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:31.571373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:31.576068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.576553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.577175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.577876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.577998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.578462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.578584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.578900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.579055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.579738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:31.580205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:31.580686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:31.608841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d595b6f2-73ff-4c82-b78d-c5ac4d7d1e5b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045141 Oct 19 22:13:31.609318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 993/1993] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:31.611267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-15c5c1ef-9a7c-4c48-afc8-fbddd05a3514 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 Oct 19 22:13:31.611831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1001/1994] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:32.121257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:32.123467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:32.129347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.132082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.132082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.132082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.132082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.132459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.160918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed7e8701-b803-4be4-8705-c0bc9454c382 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Oct 19 22:13:32.161463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 994/1995] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:32.389421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:32.391529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:32.397424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.397899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.398331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.399037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.399487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.400505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.428543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-91d2749d-6bed-4a9b-958d-ccbab401b65d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043164 Oct 19 22:13:32.429083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1002/1996] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:32.621819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:32.623959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:32.624338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:32.625865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:32.631863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.632348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.632648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.632777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.633141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.633473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.633583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.633939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.634841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:32.634975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.635325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:32.635747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:32.665458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f463ec8e-9662-4723-b0b0-0d861831e35b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048465 Oct 19 22:13:32.666018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 995/1997] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:32.666246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2d1794e9-e015-4e6f-8f54-f543381361e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046318 Oct 19 22:13:32.669691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1003/1998] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:33.172639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:33.174749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:33.180556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.181667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.182097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.182776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.183239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.183917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.211517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d8d87b56-55c2-4703-8e06-56f9b5c073f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042988 Oct 19 22:13:33.212048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 996/1999] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:33.441172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:33.443357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:33.449916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.450390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.450818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.451522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.451968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.452383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.480707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9173958e-0983-4394-81c9-a05577da1763 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Oct 19 22:13:33.481244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1004/2000] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:33.680079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:33.680709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:33.682906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:33.683043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:33.689308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.689610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.689790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.690226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.690390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.690658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.691072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.691429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:33.691548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.691825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:33.691957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.692243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:33.720093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:33.723010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f380c709-b236-4acd-acf7-0a63f3db637a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Oct 19 22:13:33.723572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1005/2001] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:33.725039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-862ba77c-7664-403b-b571-ebd4ae176153 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048911 Oct 19 22:13:33.725594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 997/2002] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:34.223299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:34.225576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:34.232194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.232674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.233110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.233793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.234246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.236860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.262842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-df23273f-da1c-474a-9e52-aec7546d1df5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Oct 19 22:13:34.263416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1006/2003] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:34.493507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:34.496290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:34.502151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.502624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.503080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.503760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.504207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.504624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.533067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3a0363c6-52e0-4133-8866-91f68e0b503d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Oct 19 22:13:34.533606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 998/2004] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:34.736125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:34.738655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:34.743345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:34.745824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.746251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.746378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:34.746693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.747428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.747887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.748307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.752126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.752801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.753231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.754184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:34.754802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:34.755365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:34.773770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:34.779401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b9ee7192-e1f8-4187-a763-aaf3bbd1afa6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047269 Oct 19 22:13:34.779953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1007/2005] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:34.785111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fd2602b5-84e5-4bd2-bbd3-4fc654b501bb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046464 Oct 19 22:13:34.789698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 999/2006] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:35.276191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:35.278312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:35.284350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.284833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.285268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.285955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.286408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.286832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.316484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-afc3b94a-9b3d-4030-ac10-961cc2d02505 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Oct 19 22:13:35.317041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1008/2007] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:35.545335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:35.547542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:35.553426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.553900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.554332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.555038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.555493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.556426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.585343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3db7862e-ffaf-40e4-b701-ee7bd788ef14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043975 Oct 19 22:13:35.585872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1000/2008] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:35.792062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:35.795766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:35.800797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:35.802927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:35.804186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.804827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.805509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.806817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.807399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.807923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.810099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.810582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.811049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.811750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:35.812199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:35.812627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:35.840224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62367ceb-e29f-4610-a616-8c48bc4bc962 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051987 Oct 19 22:13:35.841163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1009/2009] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:35.846725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74bc1955-6df4-409d-b0a8-dedebe8802c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049995 Oct 19 22:13:35.847313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1001/2010] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:36.328918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:36.331172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:36.337241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.337717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.338147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.338828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.339303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.339723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.367495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1266ba80-1ee8-4f61-afc9-281b958e2e22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 Oct 19 22:13:36.368064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1010/2011] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:36.597711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:36.599787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:36.605781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.606266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.606700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.607436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.607890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.608314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.638304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-04a0cc10-2cdb-40df-9090-de0084c79085 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Oct 19 22:13:36.638858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1002/2012] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:36.852400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:36.855213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:36.859558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:36.861534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.861946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:36.862080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.862430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.863154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.863605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.864014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.869803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.870357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.870882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.871608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:36.872058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:36.872478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:36.894871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7a6c6005-42b2-4ba7-a4fc-665933f1e62f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046384 Oct 19 22:13:36.899825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1011/2013] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:36.901708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78a231b2-d063-467d-973e-299710abc0c5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046114 Oct 19 22:13:36.902255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1003/2014] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:37.380436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:37.382546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:37.389119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.389601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.390021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.390697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.391175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.391634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.421235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bcd2afc6-5dec-49aa-b59e-cb984752580b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Oct 19 22:13:37.422014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1012/2015] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:37.650544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:37.652668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:37.659064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.659541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.659970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.660646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.661093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.661509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.690887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed5582b0-9a43-4521-8692-a20e804dc7c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Oct 19 22:13:37.691449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1004/2016] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:37.907178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:37.909188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:37.913421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:37.916288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:37.916442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.916762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.917197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.917902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.918347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.919044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.922786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.923351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.923891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.924774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:37.925335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:37.925756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:37.949559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d015c9fa-1ba7-42db-aaeb-dfdae4bb84a4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Oct 19 22:13:37.950438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1013/2017] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:37.955995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0ba321d1-af8e-47af-b1c9-03378be09be3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046382 Oct 19 22:13:37.956554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1005/2018] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:38.434019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:38.436242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:38.442124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.442608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.443072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:38.443766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.444217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.444640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:38.478580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b254ae8e-813f-4da8-8bc8-ec16effc5bba tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048428 Oct 19 22:13:38.479651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1014/2019] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:38.771003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:38.773269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:38.779198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.779676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.780107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:38.780787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.781241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.781663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:38.811423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-93dcc4b3-8c37-4bc6-b99a-96b110f88dd3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112143 Oct 19 22:13:38.811990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1006/2020] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:38.961766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:38.964048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:38.967886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:38.970072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:38.970490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.971007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.971448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:38.972148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.972610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.973036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:38.976682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.977256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.978284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:38.979058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:38.979570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:38.980058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:39.007874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-53658b22-b488-48b5-93cc-758db6298189 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050046 Oct 19 22:13:39.008509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1015/2021] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:39.010452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b4bace79-ced7-49fe-a5d7-27dc55a9cbb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046640 Oct 19 22:13:39.011012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1007/2022] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:39.491252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:39.493394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:39.499334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:39.499817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:39.500252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:39.500940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:39.501396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:39.501824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:39.530379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1df8c121-b0e5-448e-81a0-55cf481e9d20 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043065 Oct 19 22:13:39.530969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1016/2023] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:39.823935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:39.826089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:39.832098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:39.832576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:39.833006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:39.833695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:39.834144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:39.834566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:39.863309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6bf7802-46a6-43e0-bca0-d36d21c48cef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 Oct 19 22:13:39.863851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1008/2024] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:40.020573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:40.021451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:40.026762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:40.027428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:40.033295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.033782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.034091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.034207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.034570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.034909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.035151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.035392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.035719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.035833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.036173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.036595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.066476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37675084-2c23-4823-ade7-957b6fe68724 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048820 Oct 19 22:13:40.067248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1009/2025] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:40.067374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-aefc7615-56ba-4766-93c8-ab496d887475 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050716 Oct 19 22:13:40.067922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1017/2026] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:40.546473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:40.546473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:40.550905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.551416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.551847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.552522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.552971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.553390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.583498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-93c6ee51-e264-41d7-beb5-b998d895d42f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Oct 19 22:13:40.583987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1010/2027] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:40.875678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:40.877746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:40.883748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.884225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.884661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.885343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:40.885796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:40.886218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:40.914928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7279751-e920-4974-9af9-1251e6dc1cc3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Oct 19 22:13:40.916066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1018/2028] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:41.079003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:41.080450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:41.081196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:41.082776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:41.087317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.087802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.088233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.088925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.089067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.089374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.089642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.089797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.090075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.090767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.091338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.091763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.119300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-442cab93-78e8-4e4e-a518-1b86ae5c2109 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044695 Oct 19 22:13:41.119865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1011/2029] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:41.121308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-91a9abad-c713-4f56-a4fa-56c7d4b76425 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Oct 19 22:13:41.121979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1019/2030] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:41.595776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:41.597885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:41.604447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.604918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.605365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.606021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.606462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.606878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.634772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-afd07502-ac6a-4b16-98ca-cc391b248ce6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 Oct 19 22:13:41.635365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1012/2031] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:41.927906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:41.929951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:41.936216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.936686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.937119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.937788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:41.938233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:41.938650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:41.968181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0a4b81a3-2763-4c6a-b7fb-7858fea28496 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Oct 19 22:13:41.968722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1020/2032] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:42.134369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:42.136721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:42.137162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:42.139000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:42.143156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.143650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.144141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:42.144853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.145334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.145735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:42.145865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.146369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.146808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:42.147614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.148072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.148498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:42.176096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-971dfa57-459f-4791-a465-3a4132f91e96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046373 Oct 19 22:13:42.180926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1021/2033] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:42.181388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7ceb04c6-41c1-46a4-adac-dc0e66908048 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051609 Oct 19 22:13:42.181388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1013/2034] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:42.647470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:42.649606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:42.655533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.656014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.656446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:42.657133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.657585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.658005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:42.687891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-592a53c6-ade7-4488-9e2d-530418616be8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Oct 19 22:13:42.688446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1022/2035] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:42.981463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:42.983631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:42.989446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.989917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.990341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:42.991043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:42.991492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:42.991909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:43.008784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:43.028509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7ace622f-67b0-45d9-b2ff-25d7ea890258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051482 Oct 19 22:13:43.029095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1014/2036] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:43.192560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:43.193031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:43.193396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:43.193488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:43.197770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:43.198256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:43.198690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:43.199436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:43.200012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:43.200352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:43.200464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:43.200912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:43.201419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:43.202190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:43.202715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:43.203258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:43.233330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-99b55a27-5037-49ea-ba25-d6c9adcb29ef tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048042 Oct 19 22:13:43.233790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-34e76a67-6879-457b-b525-84ade94de31e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046869 Oct 19 22:13:43.233974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1023/2037] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:43.234790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1015/2038] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:43.700314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:43.702502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:43.708783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:43.709271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:43.709710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:43.710408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:43.710862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:43.711313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:43.728882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:43.741168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-790ed0a8-7db3-4357-a495-4621e6eb9600 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Oct 19 22:13:43.741729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1024/2039] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:44.040777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:44.042919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:44.048822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.049309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.049743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.050433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.050889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.051340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.081281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-48cffb6a-d5d6-43c2-ba9d-827c2b0a6e65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Oct 19 22:13:44.081860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1016/2040] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:44.245684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:44.246304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:44.248018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:44.249605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:44.254038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.254771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.255237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.255990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.256464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.256584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.256888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.256999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.257365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.258055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.258503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.259476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.289270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b3d87bd7-b347-476f-8e4e-c2e8331b809e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047018 Oct 19 22:13:44.289716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-30db89d5-637f-4fd3-b850-b831295837d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047838 Oct 19 22:13:44.290591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1025/2041] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:44.293794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1017/2042] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:13:44.758181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:44.760985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:44.766889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.767419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.767865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.768557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:44.769014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:44.769440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:44.797998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6c8c6ad5-a998-488a-9bde-c61ebcb837f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Oct 19 22:13:44.798562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1026/2043] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:45.097137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:45.099241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:45.109647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.109647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.109647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.109647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.110025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.110025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.136407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e611b0ed-629b-4928-9e03-9dc0f09bc9a6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Oct 19 22:13:45.136950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1018/2044] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:45.301776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:45.302409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:45.304397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:45.305594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:45.312078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.312566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.312756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.312998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.313263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.313692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.313890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.314345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.314462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.314768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.314877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.315277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.345601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2ebfab87-a83e-424f-b186-3a132eadfdb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Oct 19 22:13:45.345744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a0863cf0-0174-4f45-ba0b-3faa4478e513 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048508 Oct 19 22:13:45.346346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1027/2045] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:45.346518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1019/2046] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:45.810474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:45.812622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:45.818427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.818902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.819376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.820059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:45.820503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:45.820925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:45.848787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-396920c0-d4a8-4d68-a772-6a94bfd9fbec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 Oct 19 22:13:45.849325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1028/2047] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:46.148969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:46.151119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:46.157409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.157891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.158320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.159032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.159503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.159923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.189419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f8461445-036d-4e0a-8844-0c0892256bd7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Oct 19 22:13:46.189964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1020/2048] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:46.357934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:46.360766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:46.367154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.367755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.368755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.369458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.369910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.370367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.401249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f9cb994f-4a07-431c-b39b-97b7f79ef435 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047448 Oct 19 22:13:46.401970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1021/2049] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:46.432465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:46.434837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:46.442475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.442475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.442475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.442772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.443133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.443554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.472495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01649151-aa4c-4a54-bba0-29a7b0ffb430 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118712 Oct 19 22:13:46.473048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1029/2050] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:46.861355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:46.863622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:46.869298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.869772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.870197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.870869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:46.871343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:46.871761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:46.900476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-641d8fba-4fcb-49c8-9800-6d68b09524b7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 Oct 19 22:13:46.901017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1022/2051] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:47.201442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:47.203616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:47.209543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.210025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.210462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.211176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.211630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.212688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.243123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-eeb4af0b-a4bb-4b96-9a6f-7aa0fdb7f9da tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Oct 19 22:13:47.243123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1030/2052] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:47.413825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:47.416012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:47.422475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.425980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.425980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.425980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.425980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.426438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.454496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b7f72216-45f1-4118-be46-e233255440e3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044465 Oct 19 22:13:47.454988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1023/2053] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:47.484708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:47.487022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:47.493863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.494566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.495031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.495737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.496189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.496611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.526683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e4557371-890d-4d28-a3d1-df52182f24e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045936 Oct 19 22:13:47.527271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1031/2054] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:47.912587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:47.914722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:47.921109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.921586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.922013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.922697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:47.923167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:47.923591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:47.952577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e7db813b-fa3a-4dcb-841a-77bffb00abe5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Oct 19 22:13:47.953126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1024/2055] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:48.253915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:48.256087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:48.262237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.262707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.263178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:48.263854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.264302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.264718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:48.293970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e13a6c44-0e5b-4987-9787-bd63d7f262a9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Oct 19 22:13:48.294510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1032/2056] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:48.467101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:48.469229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:48.475634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.476109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.476536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:48.477218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.477663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.478076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:48.511937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7b964e71-0442-4aba-9d0c-123007f39d5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043965 Oct 19 22:13:48.511937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1025/2057] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:48.538979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:48.541240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:48.543536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:48.548209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.548693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.549154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:48.549840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.550283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.550703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:48.581022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b525444e-f156-4b0a-81dc-5bd7ab41af66 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046382 Oct 19 22:13:48.581566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1033/2058] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:48.964473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:48.966627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:48.972543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.973028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.973458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:48.974145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:48.974596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:48.975041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:49.004955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-12718afe-1a22-4f91-b7d6-87c022b8c410 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Oct 19 22:13:49.005501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1026/2059] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:49.306087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:49.308226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:49.314439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:49.314917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:49.315375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:49.316052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:49.316497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:49.316914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:49.345760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b8c934c-9f60-4860-ac1a-da3359187054 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Oct 19 22:13:49.346228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1034/2060] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:49.523087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:49.525824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:49.532137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:49.532612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:49.533040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:49.533729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:49.534172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:49.534588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:49.563395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e38f7313-2047-4c3e-a754-01435200c194 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044198 Oct 19 22:13:49.563940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1027/2061] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:49.593079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:49.595311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:49.601621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:49.601993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:49.606328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:49.606328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:49.606328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:49.606328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:49.633076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c8d69793-d16a-4626-a2dc-a21ba4ac5592 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Oct 19 22:13:49.633610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1035/2062] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:50.016958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:50.019394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:50.026917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.027639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.028571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.029462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.030145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.030561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.060407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-05a6ce34-bc9f-4f60-9716-d4cd6331a199 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047437 Oct 19 22:13:50.060959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1028/2063] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:50.358585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:50.360634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:50.366510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.367012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.367442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.368719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.369172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.369589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.397760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2437e1e4-9aa5-4011-9d5f-5cb5474545ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Oct 19 22:13:50.398301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1036/2064] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:50.575697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:50.577826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:50.584120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.584602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.585038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.585733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.586185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.586611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.616756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a4c606af-341c-4405-bd67-f26972c511e1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044942 Oct 19 22:13:50.617339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1029/2065] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:50.646186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:50.648501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:50.655496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.655984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.656419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.657109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:50.657562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:50.657983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:50.687258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a0da3c8d-2f77-40b9-a892-941af8587641 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Oct 19 22:13:50.687807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1037/2066] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:51.073250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:51.075408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:51.081274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.081745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.082172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.082851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.083316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.083725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.112672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-af79c5a7-9865-478f-b2f1-beb4db674005 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Oct 19 22:13:51.113218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1030/2067] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:51.409218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:51.411327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:51.417371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.417853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.418289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.418992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.419451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.419875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.449562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bc3622dd-0eab-4e36-9411-f9da56c81c7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Oct 19 22:13:51.450108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1038/2068] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:51.629057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:51.631223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:51.633468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:51.638692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.639235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.639668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.640357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.640802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.641265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.647896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:51.676935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-65696199-74d1-4554-b010-7d9efef79356 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048058 Oct 19 22:13:51.676935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1031/2069] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:51.700081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:51.702336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:51.711158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.711158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.711158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.711158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:51.712251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:51.712251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:51.740923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-77e80545-a867-4ee1-9a31-10a492c8c77a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Oct 19 22:13:51.741482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1039/2070] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:52.125169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:52.127343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:52.134781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.135302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.135740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.136440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.136890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.137318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.165688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-29a4642f-af1a-45ae-9d07-ce85a2320b64 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Oct 19 22:13:52.166255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1032/2071] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:52.461727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:52.463895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:52.469864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.470350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.470786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.471502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.471961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.472388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.501918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-69fd18d2-ee73-46e2-8ccd-14ff953fd6aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Oct 19 22:13:52.502468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1040/2072] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:52.686912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:52.689074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:52.695294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.695769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.696195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.696876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.697466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.697729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.726997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-44eb82c4-14bc-4e65-98a3-5c2b4583b714 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044124 Oct 19 22:13:52.728058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1033/2073] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:52.755540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:52.757672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:52.764392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.764888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.765329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.766032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:52.766486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:52.766943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:52.770789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:13:52.797441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c28f61d7-f78f-48d1-99c4-1ce7b4bb89e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Oct 19 22:13:52.798005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1041/2074] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:53.177871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:53.179991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:53.186881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.187534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.187969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.188656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.189106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.189527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.218096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fca7a712-3337-4e64-b201-a2fdf892226e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Oct 19 22:13:53.218652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1034/2075] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:53.514411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:53.516562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:53.522866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.523385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.523816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.525069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.525518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.525942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.554796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0ce40b67-43cf-4cce-8858-5e5ed4b5850a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Oct 19 22:13:53.555368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1042/2076] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:53.740026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:53.742172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:53.748384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.748870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.749304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.749994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.750448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.750872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.779889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8f4db46a-3fd0-447b-b23b-1079b65a7bc1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043711 Oct 19 22:13:53.780426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1035/2077] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:53.810206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:53.812519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:53.818879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.819468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.819983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.820809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:53.821295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:53.821798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:53.850794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6e154f45-0445-4d00-aabc-a6c06fc769c7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Oct 19 22:13:53.851363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1043/2078] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:54.230457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:54.232631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:54.238484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.238980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.239418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.242711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.242711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.242711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.271415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a4bf2150-441c-49bc-b883-4c23ae3fe511 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Oct 19 22:13:54.272007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1036/2079] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:54.567607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:54.570073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:54.576696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.577182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.577612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.578293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.578741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.579190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.607834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d8dfbf9-5943-4889-b582-1ead0ec2cc3b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Oct 19 22:13:54.608617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1044/2080] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:54.793225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:54.795477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:54.801830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.802314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.802747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.803470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.803921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.804344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.834359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a75ee9e5-e0e2-432c-a816-64f7e95d2212 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045836 Oct 19 22:13:54.835094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1037/2081] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:54.863742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:54.865873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:54.872834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.873312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.873745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.874426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:54.874877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:54.875358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:54.903824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-93dd539d-9d80-4201-9777-348bd6710ea6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Oct 19 22:13:54.904366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1045/2082] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:55.283922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:55.286072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:55.292572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.293062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.293468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.294139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.294581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.295014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.325495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b2c1a55d-eab1-4f25-a324-02cc9e055d53 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Oct 19 22:13:55.326049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1038/2083] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:55.620295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:55.622335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:55.628344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.628819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.629249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.629927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.630371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.630789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.660400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2b27f66a-11ff-4c38-b15e-67d495b5188a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Oct 19 22:13:55.660937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1046/2084] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:13:55.848434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:55.850615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:55.857179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.857668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.858108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.858934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.859458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.859887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.890188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1d31789c-0b5a-46c6-8e0c-7956549fe86b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045752 Oct 19 22:13:55.890749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1039/2085] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:55.915934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:55.918060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:55.924350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.924829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.925267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.925955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:55.926409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:55.926829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:55.957287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b1a9c00c-35e1-4020-a494-a23aa078060c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Oct 19 22:13:55.957840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1047/2086] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:56.337652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:56.339832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:56.345726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.346205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.346635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:56.347353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.347806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.348228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:56.378082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ab607656-b440-45cd-8a24-2788f1b134a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Oct 19 22:13:56.378635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1040/2087] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:56.672804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:56.674871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:56.681287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.681756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.682183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:56.682880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.683352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.683770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:56.713457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cce2cf81-d513-4120-9bd0-31928c3f365e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Oct 19 22:13:56.714002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1048/2088] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:56.902781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:56.905251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:56.911472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.911952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.912384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:56.913076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.913561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.913983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:56.947522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e5290bcf-abfc-4d58-b489-8737f340caa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045487 Oct 19 22:13:56.947522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1041/2089] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:56.969458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:56.971617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:56.978024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.978509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.978968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:56.979669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:56.980123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:56.980545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:57.010238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bec8a179-f883-46d7-9c1d-c48b65cb6607 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Oct 19 22:13:57.010778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1049/2090] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:57.390385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:57.393430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:57.398746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:57.399263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:57.399692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:57.400380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:57.400835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:57.401259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:57.431253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7aa9d13e-eb09-46c0-bdd7-d5e7996248ee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Oct 19 22:13:57.433619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1042/2091] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:57.725775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:57.730900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:57.734479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:57.734981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:57.735416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:57.736128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:57.736580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:57.737005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:57.765883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0fde4e39-e016-403c-b31a-4d5259f8958f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Oct 19 22:13:57.766436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1050/2092] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:57.961201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:57.964019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:57.970310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:57.970795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:57.971258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:57.971948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:57.972398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:57.972818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:58.001992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8bcd28a2-4223-4304-99e6-77b84c9f0622 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044799 Oct 19 22:13:58.002744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1043/2093] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:58.021523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:58.024648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:58.030627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:58.031214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:58.031651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:58.032345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:58.032801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:58.033229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:58.063854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-987a2edf-9f97-4d0f-9538-404e47391d9c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046132 Oct 19 22:13:58.064402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1051/2094] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:58.443950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:58.446114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:58.451954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:58.452438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:58.452866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:58.453559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:58.454010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:58.454432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:58.483097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d8b98a1c-d8ec-460e-80cf-1b039d015ab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043102 Oct 19 22:13:58.483658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1044/2095] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:58.778917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:58.780991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:58.787113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:58.787606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:58.788049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:58.788928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:58.789189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:58.789617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:58.819299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5dc197c4-6b59-4b6c-a1a4-9c29afa31025 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Oct 19 22:13:58.819852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1052/2096] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:59.014296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:59.016462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:59.022879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.023395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.023831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.025062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.025514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.025939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.059243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5740db18-0d75-4b91-ba7b-9acf850674c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048585 Oct 19 22:13:59.059913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1045/2097] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:13:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:13:59.077628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:59.080344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:59.087474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.087967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.088410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.089111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.089574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.090000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.120133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b6d1805c-a37d-405f-93fe-b35c1e9e1c37 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046516 Oct 19 22:13:59.120689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1053/2098] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:59.495281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:59.497397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:59.503262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.503740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.504172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.504853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.505306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.505726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.534942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74e2c9f4-cdcc-4acc-a04b-1302d344628a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Oct 19 22:13:59.535689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1046/2099] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:13:59.832151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:13:59.834243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:13:59.840172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.840648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.841077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.841750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:13:59.842198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:13:59.842615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:13:59.871197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a16e7df3-5ae9-4e1d-bc5a-f1737cd8df53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043041 Oct 19 22:13:59.871754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1054/2100] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:13:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:00.076966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:00.079486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:00.086003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.086650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.086912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.087684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.088139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.088561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.113891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:00.119789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d0c4ad42-fe78-4175-9d88-4748633e5601 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046858 Oct 19 22:14:00.120362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1047/2101] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:00.135514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:00.135514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:00.141440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.141920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.142357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.143070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.143526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.143949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.178274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0dee49c0-6e5d-4877-9ffc-6f1988fa5629 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049772 Oct 19 22:14:00.179187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1055/2102] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:00.547644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:00.549770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:00.556429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.556906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.557336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.558018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.558467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.558886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.587892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bbd2c85a-4fbe-4133-a529-731ba2072bd4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Oct 19 22:14:00.588434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1048/2103] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:00.883807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:00.885948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:00.892114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.892589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.893015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.893692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:00.894169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:00.894591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:00.923212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c860fe50-8645-423d-b1c8-2e4740737365 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043363 Oct 19 22:14:00.923755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1056/2104] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:01.132394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:01.134483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:01.140947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.141447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.141873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.142575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.143057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.143485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.174065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69e94f5f-d35a-41b7-baf3-a8ca17b9c737 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045671 Oct 19 22:14:01.174637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1049/2105] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:01.193684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:01.195849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:01.202653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.203161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.203597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.204289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.204734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.205179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.231506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:01.236153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e34f2999-538d-47d7-8101-cc3321d9903d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048508 Oct 19 22:14:01.236710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1057/2106] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:01.600229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:01.602876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:01.608748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.609231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.609664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.610351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.610804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.611259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.639507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3d882ec9-c034-4447-b809-7baed4b82b10 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Oct 19 22:14:01.640042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1050/2107] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:01.935796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:01.937840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:01.944224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.944707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.945145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.945829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:01.946279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:01.946700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:01.975309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7c19ee2-1468-4a33-b2c0-6d0ee1a8842e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Oct 19 22:14:01.975855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1058/2108] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:02.187761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:02.189855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:02.196386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.196873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.197313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:02.198013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.198467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.198895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:02.228402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-35d5360d-24a6-4ed7-9a94-1105844ad675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044945 Oct 19 22:14:02.228962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1051/2109] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:02.248850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:02.251019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:02.258890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.259400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.259831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:02.260520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.260983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.261559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:02.292095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-53f0d2e5-dd30-4a24-b2c5-3710c92e9f49 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Oct 19 22:14:02.292777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1059/2110] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:02.652599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:02.654699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:02.660538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.661007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.661433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:02.662104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.662548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.662989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:02.691593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-281fd4ff-2143-4f38-9b3f-9cb523f824ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Oct 19 22:14:02.692133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1052/2111] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:02.988093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:02.990229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:02.996265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.996745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.997180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:02.997866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:02.998323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:02.998748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:03.028636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5964f02a-e7f3-4075-bf92-dd041da21fa1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Oct 19 22:14:03.029186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1060/2112] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:03.240761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:03.243468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:03.250145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:03.250617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:03.251065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:03.251772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:03.252220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:03.252637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:03.283512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-207cff4d-3aa0-4b57-9bfd-298381461673 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046638 Oct 19 22:14:03.284067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1053/2113] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:03.304153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:03.307119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:03.313510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:03.313959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:03.314306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:03.315089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:03.315514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:03.315933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:03.345466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-93d75420-2a0c-450f-abc2-cc8d2a8cd439 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Oct 19 22:14:03.346016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1061/2114] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:03.704116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:03.706221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:03.712081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:03.712554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:03.712983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:03.713662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:03.714562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:03.714562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:03.743753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1da75b04-990a-4836-bd08-373e971a369b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 Oct 19 22:14:03.744341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1054/2115] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:04.041279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:04.043376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:04.045332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:14:04.045476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:14:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:14:04.051930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.052464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.052900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.053595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.054065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.054468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.084028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d58cc6e0-541d-4f86-8fdb-4cca8aabd564 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047416 Oct 19 22:14:04.084588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1062/2116] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:04.296907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:04.299014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:04.305555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.306041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.306481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.307202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.307659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.308086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.338418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-96eb8170-72d8-40c4-93c2-68c5b207cd8c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045514 Oct 19 22:14:04.338994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1055/2117] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:04.358423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:04.360740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:04.367034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.367529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.367953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.368938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.369455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.369874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.400226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6432cc9b-a0cb-4575-bf23-81008511d288 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Oct 19 22:14:04.400792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1063/2118] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:04.755440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:04.759271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:04.764119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.764599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.765029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.765710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:04.766157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:04.766576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:04.796260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-440886c7-5435-4703-8e70-5dd838b5a5f1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Oct 19 22:14:04.796816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1056/2119] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:05.096731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:05.098798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:05.105548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.115520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.115520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.115520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.115520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.115860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.137097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ff18ed93-96e9-4e4c-9503-5dadea481771 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044427 Oct 19 22:14:05.137648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1064/2120] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:05.351077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:05.353156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:05.355125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:14:05.355271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:14:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:14:05.356986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:14:05.357104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:14:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:14:05.373068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.373541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.373999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.374679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.375155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.375581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.408647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dbbda824-d08b-42f6-9c17-19400860e2f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061539 Oct 19 22:14:05.409373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1057/2121] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:05.412424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:05.414572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:05.420712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.421197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.421633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.422326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.422782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.423539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.453441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3ee1ece1-7489-4957-9008-16228aec3359 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Oct 19 22:14:05.453999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1065/2122] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:05.808432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:05.810872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:05.816815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.817293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.817728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.818406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:05.818859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:05.819316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:05.847330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-68cdf95c-48fe-4a8d-8ce5-1a5d7f799cbf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Oct 19 22:14:05.847866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1058/2123] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:06.148864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:06.151548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:06.157601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.158076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.158508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.159218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.159672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.160093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.188881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17e79f39-0050-4c1d-9df1-202aeda138c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Oct 19 22:14:06.189428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1066/2124] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:06.420420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:06.422518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:06.428878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.429359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.429798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.431062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.431524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.431948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.462169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-89368056-c662-480c-9923-60ff9492ee78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045830 Oct 19 22:14:06.462906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1059/2125] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:06.465740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:06.467905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:06.473913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.474398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.474833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.475545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.475996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.476416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.506998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3fd2d79d-7907-408b-a9b8-41d83c397688 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Oct 19 22:14:06.507564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1067/2126] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:06.859613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:06.861742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:06.867613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.868714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.869139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.869808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:06.870252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:06.870666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:06.898169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-10dba370-9289-4c0e-b9d7-5f15cf55c5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042478 Oct 19 22:14:06.898711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1060/2127] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:07.201841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:07.204035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:07.209963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.210440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.210871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.211614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.212062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.212478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.240517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-74c0dcbf-08a8-4f97-b55f-ff6b4f6bf460 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 Oct 19 22:14:07.241055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1068/2128] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:07.474822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:07.476946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:07.483930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.484411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.484841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.485525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.485976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.486399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.516631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3323cb26-8e94-43b9-aba2-38bdb44d8128 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045914 Oct 19 22:14:07.517335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1061/2129] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:07.520134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:07.522401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:07.528798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.529836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.530416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.530876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.531327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.562863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ba9154af-bdb7-4f83-9b32-64c1322ec638 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047157 Oct 19 22:14:07.563472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1069/2130] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:07.910586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:07.912786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:07.919263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.919737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.920164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.920836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:07.921282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:07.921700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:07.949742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-07b49e82-24a5-4372-b3da-a1bb94811aa7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043162 Oct 19 22:14:07.950553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1062/2131] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:08.252571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:08.255003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:08.261586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.262072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.262508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.263217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.263668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.264118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.293011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03dbdb29-13db-41b6-ab58-e064dbf6615c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Oct 19 22:14:08.293561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1070/2132] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:08.529196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:08.531280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:08.537605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.538076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.538510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.539208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.539652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.540069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.569905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-10cc5b81-9041-49d4-9547-13770b0e672f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045254 Oct 19 22:14:08.574990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1063/2133] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:08.578036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:08.580325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:08.586321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.586808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.587275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.587964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.588444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.588835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.632784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9163ebfe-3d97-44b7-9373-c8531b4df2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060329 Oct 19 22:14:08.633345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1071/2134] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:08.962377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:08.964594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:08.970416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.970894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.971353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.972026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:08.972474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:08.972891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:08.989246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:09.001794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ddc2496-80b0-4c89-8fa5-a4af7166b0e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Oct 19 22:14:09.007305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1064/2135] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:09.305575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:09.307674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:09.313932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:09.314416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:09.314852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:09.315567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:09.316019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:09.316441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:09.345376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4d5a878a-d7e8-4423-a519-ca7df382c6b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043898 Oct 19 22:14:09.345939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1072/2136] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:09.583720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:09.585779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:09.592293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:09.592767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:09.593198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:09.593871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:09.594316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:09.594731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:09.623878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-667a4bfe-7ff9-4c96-8322-74b69ac1001d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044535 Oct 19 22:14:09.624618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1065/2137] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:09.648219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:09.650402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:09.661897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:09.661897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:09.661897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:09.661897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:09.662389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:09.662389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:09.690409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4df39df-11cc-481c-9c2f-3a3a2f786c41 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046306 Oct 19 22:14:09.690988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1073/2138] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:10.017711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:10.019909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:10.026286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.026760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.027221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.027900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.028357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.028775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.057454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-da8965db-20dc-4bc1-a36e-c1f42d2ce6d6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Oct 19 22:14:10.058003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1066/2139] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:10.358395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:10.360506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:10.366451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.366930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.367385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.368072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.368523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.368943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.385632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:10.398073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7337b9dc-6227-49a7-9055-7ee35f8da541 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Oct 19 22:14:10.398646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1074/2140] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:10.636564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:10.638612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:10.644997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.645477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.645908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.646579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.647045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.647465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.676541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a3432946-616a-4c76-aac3-d6d5d002764b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044410 Oct 19 22:14:10.677065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1067/2141] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:10.703143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:10.705341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:10.712792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.713279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.713717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.714417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:10.714876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:10.715334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:10.747697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f5ee929e-3a8f-4364-bd4a-2337621fed8c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048642 Oct 19 22:14:10.748319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1075/2142] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:11.069725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:11.072832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:11.078511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.079019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.079452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.080213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.080661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.081079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.109217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b387155b-b208-4aa5-80b5-60b4e941b777 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Oct 19 22:14:11.118769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1068/2143] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:11.410629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:11.412770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:11.419317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.419791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.420226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.420915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.421364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.421785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.451790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-89e51a57-fe12-40db-ac02-1ec12f1b7a26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Oct 19 22:14:11.452332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1076/2144] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:11.689852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:11.692797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:11.699452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.699957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.700367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.701048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.701493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.701911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.732450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2db83ab-fda8-465b-8e18-0eb227247baf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046569 Oct 19 22:14:11.733002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1069/2145] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:14:11.759094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:11.761356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:11.767969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.768458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.768897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.769613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:11.770068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:11.770493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:11.803042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2f1183fc-8fea-4aa5-b54a-34d76425321a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047822 Oct 19 22:14:11.803915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1077/2146] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:12.129163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:12.131322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:12.137722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.138221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.138651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.139353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.139920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.140341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.168724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2a12014f-a848-4205-a846-193a6ad23c08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Oct 19 22:14:12.169264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1070/2147] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:12.464347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:12.466552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:12.472501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.472984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.473420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.474103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.474558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.474996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.503790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e5dac8e9-38aa-4bc1-8cdd-f03841ce75b0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Oct 19 22:14:12.504328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1078/2148] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:12.745854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:12.747942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:12.754269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.754742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.755203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.755876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.756328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.756747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.784699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3b8a2964-38e7-45ab-a1ae-e39b7ee945a1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043553 Oct 19 22:14:12.785245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1071/2149] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:12.815668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:12.817877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:12.824230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.824706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.825146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.825842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:12.826298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:12.826722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:12.856344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-85bb4fda-1a40-4dc1-ab4b-ce7a64473da6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044656 Oct 19 22:14:12.856910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1079/2150] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:13.181058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:13.183182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:13.189242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.189715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.190142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.190816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.191304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.191721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.219890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c324e6a-47a5-4c8c-817b-39237244ac33 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Oct 19 22:14:13.220431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1072/2151] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:13.515634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:13.517758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:13.523674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.524783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.525221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.525906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.526362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.526781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.555015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8f238f7b-9d69-4ad3-9186-1fad66cb78b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 Oct 19 22:14:13.555609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1080/2152] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:13.796803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:13.799060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:13.805021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.806007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.806468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.807187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.807646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.808071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.837622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a5cef6a1-c380-4454-a585-e8d2d306dd3c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044833 Oct 19 22:14:13.838179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1073/2153] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:13.868369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:13.870497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:13.876895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.877374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.877808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.878501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:13.878992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:13.879405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:13.910373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b5b895e8-0ca6-4a98-9317-f1a774797d19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046423 Oct 19 22:14:13.915137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1081/2154] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:14.231940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:14.234060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:14.236026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:14:14.236159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:14:14.243585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.244102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.244671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.245370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.245826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.246255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.275861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-346c1c32-9bd0-42bb-ab05-931e02d25558 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048484 Oct 19 22:14:14.276417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1074/2155] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:14.568040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:14.570153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:14.576737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.577215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.577644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.578327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.578983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.579408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.610256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-23d27844-9125-4278-95c8-bb6a4076acdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Oct 19 22:14:14.611031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1082/2156] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:14.850047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:14.853191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:14.859347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.873749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.873749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.873749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.873749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.874324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.891342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f9d955fe-af82-4a09-84ef-b39da6c13554 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045273 Oct 19 22:14:14.891912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1075/2157] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:14:14.922668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:14.924893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:14.928299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:14.931778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.932267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.932705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.933409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:14.933868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:14.934567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:14.969720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a81e5f4c-9e60-40ef-a6fb-6c717fcf768e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050954 Oct 19 22:14:14.970312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1083/2158] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:15.288254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:15.290418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:15.296762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.297234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.297663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:15.298339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.298789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.299241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:15.329153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c77a5373-b10b-4216-97e2-15170d36e8de tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Oct 19 22:14:15.329692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1076/2159] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:15.623475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:15.625712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:15.631715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.632200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.632642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:15.633984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.634448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.634875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:15.663216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-11ba2e05-6974-4ae6-8c0a-39829b6afc6c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Oct 19 22:14:15.663763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1084/2160] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:15.903872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:15.905917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:15.911850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.912356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.912783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:15.913454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.913893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.914307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:15.944242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3bbf98a9-6041-4e8c-9459-c81a443492d6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044359 Oct 19 22:14:15.944788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1077/2161] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:15.982560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:15.984762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:15.991228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.991711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.992187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:15.993466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:15.993924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:15.994351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:16.023652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a3b4676f-a84e-4f27-925c-50daed8fc5cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Oct 19 22:14:16.028602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1085/2162] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:16.341909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:16.344104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:16.350386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:16.350863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:16.351329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:16.352012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:16.353108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:16.353530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:16.381379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5bfd2ce7-26c9-4c26-90af-9803ea36af93 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Oct 19 22:14:16.381924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1078/2163] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:16.676385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:16.678509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:16.684892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:16.685374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:16.685808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:16.686496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:16.686977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:16.687402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:16.716888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03da6770-584b-4d00-9c2f-b076c3645e0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Oct 19 22:14:16.717436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1086/2164] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:16.956831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:16.959014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:16.966012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:16.966012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:16.966530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:16.967371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:16.967939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:16.968364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:16.998442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3ea11826-d26a-426f-8cee-1ed66125deea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045636 Oct 19 22:14:16.999069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1079/2165] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:17.036340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:17.038496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:17.045076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:17.045554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:17.046110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:17.046851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:17.047323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:17.047743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:17.079873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c6693a0-331c-4821-a09b-00360d1c9a78 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047343 Oct 19 22:14:17.084715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1087/2166] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:17.393756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:17.395912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:17.402039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:17.402511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:17.403007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:17.408012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:17.408012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:17.408012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:17.434595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-54fae2ac-64ee-4939-b0b8-efe858ff5d3f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Oct 19 22:14:17.435173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1080/2167] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:17.732876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:17.732876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:17.737414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:17.737887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:17.738314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:17.739008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:17.739459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:17.739978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:17.768820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ef861c40-9334-4dcb-9d77-fa928be06b01 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Oct 19 22:14:17.769314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1088/2168] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:18.011493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:18.013676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:18.015542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:18.020160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.020567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.021000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.021674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.022126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.022545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.026837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:18.051217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7d279b21-609e-4521-adde-44929eae7cc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044186 Oct 19 22:14:18.051756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1081/2169] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:18.093145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:18.095431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:18.101766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.102248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.102682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.103388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.103864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.104284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.135085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b6e1a0b3-cab5-43f9-8f15-2a4eddf8940b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Oct 19 22:14:18.135550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1089/2170] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:18.448894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:18.451077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:18.457737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.458209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.458637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.459355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.459801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.460218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.488470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74939aeb-1ed8-4841-8bb7-e44d378c51d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Oct 19 22:14:18.489015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1082/2171] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:18.781207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:18.783308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:18.789998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.790496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.790932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.791646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:18.792101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:18.792528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:18.822043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c542b4c1-bf6d-4090-b9ff-52187c6cc686 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 Oct 19 22:14:18.822594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1090/2172] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:19.064337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:19.066405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:19.072466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.072953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.073392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.074085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.074541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.075009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.105503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c7e7c086-dc65-4b3b-a0d4-683a50042348 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045403 Oct 19 22:14:19.109867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1083/2173] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:19.147476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:19.150230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:19.156639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.157101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.161173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.161173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.161173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.161173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.162738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:19.190187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f2e74287-ba8e-47b0-b37b-40e0373c0609 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046722 Oct 19 22:14:19.190933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1091/2174] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:19.501272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:19.503426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:19.510218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.510688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.511142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.511815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.512260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.512677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.541634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0d0e0545-3151-48f4-9999-53462b450e97 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Oct 19 22:14:19.542170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1084/2175] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:19.834448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:19.836629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:19.843066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.843554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.843992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.844680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:19.845138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:19.845565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:19.874106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a0863ecd-e0b2-4107-95cd-1127588b3782 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Oct 19 22:14:19.874647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1092/2176] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:20.118862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:20.121021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:20.126973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.127504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.128059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.128737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.129187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.129605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.159048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1677d759-f867-4146-bdf5-775350fbb696 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044844 Oct 19 22:14:20.159595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1085/2177] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:20.202012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:20.204176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:20.210487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.210996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.211441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.212127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.212585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.213011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.244043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e0c1628e-037c-4f17-a789-88df4387e6c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Oct 19 22:14:20.248628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1093/2178] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:20.553708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:20.556051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:20.562615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.563127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.563561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.564268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.564716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.565136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.593731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b1a545b8-38d0-4d03-8222-a83e8dff7fcf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Oct 19 22:14:20.594274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1086/2179] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:20.886239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:20.888372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:20.894340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.894862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.895344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.896029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:20.896488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:20.896918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:20.926360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d2f500c9-9cbf-4693-9fc8-d350bab66144 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Oct 19 22:14:20.926941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1094/2180] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:21.171199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:21.173279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:21.179305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.179783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.180218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.180899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.181351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.181779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.210742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-abc5747e-e122-47cd-b3a4-65a2d240a079 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043655 Oct 19 22:14:21.211310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1087/2181] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:21.256292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:21.259099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:21.265442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.265927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.266362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.267079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.267534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.267960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.297375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-46661fe6-8479-4a84-a407-b1bc5f5daa7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Oct 19 22:14:21.297940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1095/2182] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:21.605799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:21.607955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:21.614237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.614718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.615187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.615869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.616348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.616775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.646130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-31a59056-ff40-4047-9ab0-f7f00dffdfdd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Oct 19 22:14:21.646674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1088/2183] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:21.939303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:21.941394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:21.947355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.947854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.948285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.948967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:21.949417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:21.949838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:21.978696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a227eee3-ffac-4d39-ac41-07db3dea47eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Oct 19 22:14:21.979263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1096/2184] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:22.223931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:22.226114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:22.232003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:22.232486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:22.232922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:22.233598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:22.234046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:22.234470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:22.263846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-05ae94aa-bfbf-4302-bf11-14416bafea9a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043895 Oct 19 22:14:22.264394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1089/2185] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:22.310467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:22.312622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:22.318836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:22.319341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:22.319773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:22.320442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:22.321541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:22.321962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:22.350391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0c0d3b55-592d-4768-8413-32bd6d250bfb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Oct 19 22:14:22.350946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1097/2186] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:22.658498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:22.660601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:22.667422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:22.667899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:22.668325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:22.669003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:22.669453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:22.669872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:22.698353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a68622b-cf07-455a-ad76-4e7385a9149f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043865 Oct 19 22:14:22.698889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1090/2187] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:22.991041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:22.993177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:22.999091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:22.999562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:22.999995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.000663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:23.001111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:23.001529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.030399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8f8718a4-3ff4-4163-a63c-c98c36ac9c32 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043219 Oct 19 22:14:23.030980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1098/2188] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:23.277081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:23.279187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:23.285101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:23.285584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:23.286020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.286702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:23.287191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:23.287618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.316007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-55acb351-6521-4fd0-a6b7-795c3d26d511 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043618 Oct 19 22:14:23.316550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1091/2189] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:23.361925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:23.364067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:23.370305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:23.370776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:23.371237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.371910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:23.372352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:23.372769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.401969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f0d464b5-8830-4ecb-8db8-f9b3faba0471 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 Oct 19 22:14:23.402508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1099/2190] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:23.711517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:23.713787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:23.720310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:23.720863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:23.721298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.722037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:23.722485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:23.722910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:23.753110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-57134d9a-f72a-4be3-b7bc-0533e2825282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Oct 19 22:14:23.753651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1092/2191] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:24.043533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:24.046811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:24.053014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.053496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.053936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.054624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.055816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.056559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.088357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-885138d8-727c-4478-ab6d-8c0901966e85 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049340 Oct 19 22:14:24.088953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1100/2192] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:24.328655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:24.330742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:24.337644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.338136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.338597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.339323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.339774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.340199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.373504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9a52adf3-a9b5-45f3-b694-3e58f6708740 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048888 Oct 19 22:14:24.374062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1093/2193] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:24.413592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:24.416390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:24.422721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.423233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.423671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.424347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.424794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.425212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.453978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3296da0-935b-421f-9c6a-9cc1ec784f33 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Oct 19 22:14:24.454518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1101/2194] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:24.765248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:24.767393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:24.773685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.775291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.775291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.775291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:24.776216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:24.776216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:24.806371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-17d07a67-da50-4007-960f-ed0363384b89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Oct 19 22:14:24.806925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1094/2195] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:25.105296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:25.107453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:25.113447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.113931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.114374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.115087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.115563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.115995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.144614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ad8398ce-6ad7-4f74-b5b4-0f68c54194e1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Oct 19 22:14:25.145169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1102/2196] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:25.386271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:25.388456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:25.394287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.394761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.395240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.395918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.396366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.396782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.425337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a7f4de30-167a-4fc4-9550-d57ed2fc9f22 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043536 Oct 19 22:14:25.425874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1095/2197] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:25.468320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:25.470511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:25.476823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.477304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.477747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.478431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.478894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.479348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.507606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8dad7774-591f-436c-a5e3-701e6fab2ba8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Oct 19 22:14:25.508641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1103/2198] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:25.818542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:25.821382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:25.827738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.828212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.828640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.829318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:25.829766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:25.830186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:25.858239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fcee51ad-1b99-4a60-8de2-312ee708a623 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Oct 19 22:14:25.858777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1096/2199] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:26.157640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:26.159830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:26.166229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.166709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.167175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.167858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.168312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.168731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.197866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0c5809b1-8035-42d3-8a93-8c43412ab892 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Oct 19 22:14:26.198413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1104/2200] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:26.438116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:26.440220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:26.446032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.446508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.446937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.447635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.448079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.448495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.472693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:26.477723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e9a72cf2-f2a1-4cb6-8faa-debb114ad386 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043476 Oct 19 22:14:26.478257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1097/2201] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:14:26.520201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:26.522326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:26.529141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.529622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.530059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.530744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.531223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.531648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.561295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6923c143-b835-4b57-8231-7ff4f9e1a4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044975 Oct 19 22:14:26.561836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1105/2202] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:26.870930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:26.873080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:26.879796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.880269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.880697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.881368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:26.881811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:26.882231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:26.910352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dea3eb0a-1d89-4457-949c-e718f1eb376d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Oct 19 22:14:26.910886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1098/2203] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:27.209629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:27.212449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:27.218472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.218983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.219418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.220099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.220553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.220975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.250167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fcd910bb-8bef-4142-8261-763d0bae5ab1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Oct 19 22:14:27.250700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1106/2204] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:27.490330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:27.493004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:27.498850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.499352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.499777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.500449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.500894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.501312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.531708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9279c9f5-32b9-43be-8ba1-8ae4ea4fd394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045180 Oct 19 22:14:27.532270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1099/2205] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:27.573842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:27.576001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:27.582345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.582825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.583298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.583981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.584432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.584854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.608841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:27.613406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e208e1b0-a557-461a-8706-e0100612843b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Oct 19 22:14:27.613948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1107/2206] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:27.923067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:27.925176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:27.932072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.932542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.932971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.933647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:27.934094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:27.934768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:27.962673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9251f740-c307-41cd-9bab-5bd2211adc13 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Oct 19 22:14:27.963238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1100/2207] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:28.262304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:28.264498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:28.270924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.271441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.271877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:28.272560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.273010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.273434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:28.302680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-af360621-ab33-473c-8b77-39c3b82f8bcf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Oct 19 22:14:28.303240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1108/2208] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:28.544287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:28.546463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:28.552307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.552791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.553229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:28.553911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.554365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.554790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:28.583968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f0d6d44a-f080-4677-806c-41b117b1f1ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043688 Oct 19 22:14:28.584514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1101/2209] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:28.626153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:28.628355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:28.635135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.635620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.636056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:28.636735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.637184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.637607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:28.666333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-111e3306-8664-4e7c-a2df-0c862f78e440 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Oct 19 22:14:28.666877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1109/2210] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:28.974807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:28.977008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:28.983282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.983755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.984184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:28.984855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:28.985300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:28.985716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:29.014487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f9a19836-4373-409c-9439-709b932ec079 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Oct 19 22:14:29.015035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1102/2211] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:29.315181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:29.317323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:29.323238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:29.323713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:29.324145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:29.324816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:29.325262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:29.325678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:29.354603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d07e4b7b-4111-4970-845e-e31e392bba2c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Oct 19 22:14:29.355179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1110/2212] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:29.597124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:29.599285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:29.605797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:29.606301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:29.606738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:29.607453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:29.607904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:29.608331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:29.636407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3bc0811f-05cd-4b1d-a646-4459163553f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043329 Oct 19 22:14:29.636950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1103/2213] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:29.677501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:29.679674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:29.686339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:29.686814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:29.687273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:29.687951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:29.688400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:29.688819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:29.717507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8d5c7de2-05fd-4627-83c7-2a1300c2f115 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Oct 19 22:14:29.718053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1111/2214] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:30.026936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:30.034142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:30.035348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.035856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.036291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.036979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.037432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.037858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.066169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-29ca8d75-f692-4203-af4d-4b6da08ec673 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Oct 19 22:14:30.067715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1104/2215] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:30.366422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:30.369059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:30.374920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.375429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.375857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.376528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.377000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.377419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.406316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac11d326-4bc8-41ca-bb13-34efbf64ad15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Oct 19 22:14:30.406856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1112/2216] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:30.648887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:30.650938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:30.656879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.657356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.657792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.658471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.658919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.659367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.688624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09f9e7d1-6a48-4d2d-b7b5-1d3b0283fcae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043822 Oct 19 22:14:30.689164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1105/2217] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:30.730096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:30.732288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:30.738774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.739298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.739733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.740421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:30.740900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:30.741327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:30.770311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18b01fee-19d4-4ab5-ab3a-04cdaac26ed1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044668 Oct 19 22:14:30.770858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1113/2218] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:31.078722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:31.080875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:31.087755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.088231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.088661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.089342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.089791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.090212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.119831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69beff32-0d58-4672-a9bc-f4269a03b3c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Oct 19 22:14:31.120386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1106/2219] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:31.417609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:31.419761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:31.426335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.426807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.427266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.427938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.428379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.428792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.458412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-100fccf8-e00c-4cfd-b6a0-37d86361fa0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 Oct 19 22:14:31.458965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1114/2220] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:31.701500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:31.703703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:31.710227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.710714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.711193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.712527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.712983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.713410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.742089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3ab3a9a9-44ba-418f-a188-cf0cea0c1fe9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044523 Oct 19 22:14:31.743193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1107/2221] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:31.783117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:31.785379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:31.792692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.793178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.793616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.794314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:31.794772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:31.795228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:31.825341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-347ff1ed-e943-46f8-acee-0dc8bf34ebad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047039 Oct 19 22:14:31.825895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1115/2222] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:32.132169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:32.134944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:32.141280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.141759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.142195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.142880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.143359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.143782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.172558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f3882ca6-aefc-4e9c-9630-5e4140be0191 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Oct 19 22:14:32.173170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1108/2223] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:32.471193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:32.473334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:32.479800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.480286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.480720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.481401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.481853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.482271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.512327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9fcee75d-7599-41ef-854c-0208614a1a96 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Oct 19 22:14:32.512870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1116/2224] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:32.755084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:32.757225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:32.763170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.763647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.764085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.764755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.765200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.765619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.796490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e2b0738e-5d12-4858-b6ac-c7937d5c5ba1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045383 Oct 19 22:14:32.797061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1109/2225] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:32.837158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:32.839376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:32.845665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.846146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.846584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.847291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:32.847747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:32.848169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:32.877910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5f708bef-e75f-4a34-8edb-94c270f3d315 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Oct 19 22:14:32.878448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1117/2226] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:33.270301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:33.272479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:33.278251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.278730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.279204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.279894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.280346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.280767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.309067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ef213571-25a9-4cc6-9132-5dbf0e0d5b88 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128164 Oct 19 22:14:33.309888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1110/2227] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:33.526352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:33.528471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:33.534557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.535112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.535530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.536212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.536662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.537086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.566124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-abc085aa-0e51-4f9c-a4e8-da463b620d7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043815 Oct 19 22:14:33.566668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1118/2228] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:33.810401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:33.812578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:33.818471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.818970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.819424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.820115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.820572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.820998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.848935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a5ba5d41-296d-4cf5-be94-ee687bcbb6b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042782 Oct 19 22:14:33.849479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1111/2229] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:33.889572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:33.891730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:33.897574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.898049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.898503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.899222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:33.899671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:33.900088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:33.928959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0237f630-0990-47e5-8381-db416d0cb211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Oct 19 22:14:33.929503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1119/2230] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:34.322391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:34.324464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:34.330746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.331255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.331690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.332370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.332817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.333238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.361431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-57d3af83-2590-403f-a625-5d79108fe5fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 Oct 19 22:14:34.361973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1112/2231] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:34.578629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:34.580722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:34.587063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.587544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.587980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.588661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.589110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.589534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.619036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f24c8059-e9ee-402f-bd4d-a91488754a06 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 Oct 19 22:14:34.619572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1120/2232] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:34.861539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:34.863595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:34.869975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.870446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.870875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.871580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.872026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.872443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.900906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e866e19-4e86-47a2-a51e-9b2b9a4e4c17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043421 Oct 19 22:14:34.901444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1113/2233] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:34.941097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:34.943279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:34.950017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.950507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.950972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.951708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:34.952502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:34.952939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:34.981455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-91bf2d25-50c2-4420-9bec-3ceac6cc52f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Oct 19 22:14:34.982022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1121/2234] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:35.374567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:35.376667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:35.382933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:35.383427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:35.383852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:35.384519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:35.384961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:35.385376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:35.401440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:35.413507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8819c3f6-96c0-4474-84bb-285264c6a24f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Oct 19 22:14:35.414043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1114/2235] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:35.631556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:35.634337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:35.640716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:35.641203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:35.641650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:35.642339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:35.642798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:35.643248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:35.671535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3c0503d7-1cb7-4dec-a700-990d663cf198 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044143 Oct 19 22:14:35.672083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1122/2236] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:35.913420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:35.916035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:35.922383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:35.922857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:35.923320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:35.924000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:35.924449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:35.924862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:35.953726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0c9e3e71-b81d-4b91-a3cd-0d540e8dd710 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044409 Oct 19 22:14:35.954265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1115/2237] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:35.994078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:35.996291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:36.002089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.002571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.003034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:36.003723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.004175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.004600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:36.032516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9ba98f46-9352-433f-86fb-699982478675 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Oct 19 22:14:36.033061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1123/2238] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:36.426343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:36.428491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:36.435042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.435471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.435907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:36.436577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.437027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.437447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:36.466135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0618ca37-e02d-4774-8cd4-db2ebea9400d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Oct 19 22:14:36.466682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1116/2239] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:36.684266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:36.686690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:36.692953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.693430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.693859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:36.694535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.694999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.695419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:36.711852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:36.724364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0edf8309-2828-426a-bed1-5cd63c85351d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044610 Oct 19 22:14:36.724914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1124/2240] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:36.965747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:36.967915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:36.973807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.974293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.974718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:36.975434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:36.975888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:36.976312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:37.005421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8e2a19bd-201c-4804-afc8-f754c58b189a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043651 Oct 19 22:14:37.005961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1117/2241] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:37.045183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:37.047333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:37.053635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:37.054094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:37.054537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:37.055242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:37.055690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:37.056111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:37.084365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6b459df2-8bc1-4333-9c91-f8fbc64d2736 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043168 Oct 19 22:14:37.084910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1125/2242] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:37.477698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:37.479917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:37.486166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:37.486636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:37.488695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:37.488695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:37.488695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:37.488695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:37.517680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1e4006fc-074c-44ad-889f-7d2dc25afa38 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Oct 19 22:14:37.517680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1118/2243] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:37.744450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:37.746618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:37.753154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:37.753646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:37.754085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:37.754775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:37.755263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:37.755701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:37.785365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76c7f4c8-9c35-4005-8464-77533a242a7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Oct 19 22:14:37.785912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1126/2244] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:38.017755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:38.019899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:38.025773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.026283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.026716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.027426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.027883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.028306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.057063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-28234063-ff43-4ec6-b4ea-38ecfd1c6e10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043186 Oct 19 22:14:38.057544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1119/2245] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:38.096977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:38.099196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:38.105604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.106091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.106850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.107236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.107695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.108123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.137634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-30fe09a0-7390-46f3-8306-15065c1a7460 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Oct 19 22:14:38.138179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1127/2246] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:14:38.359258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:38.359751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:38.365643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.366119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.366544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.367253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.367698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.368135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.393283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Going to try to terminate instance {{(pid=121022) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:14:38.529953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:38.532104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:38.538872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.539383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.539881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.541142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.541589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.542028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.571717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f449ced0-f4b3-4605-be77-8aac41ff8f3e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Oct 19 22:14:38.572267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1128/2247] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:38.748070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fdcb90d2-1b92-4171-85f7-f552626d1bda tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 204 len: 0 microversion: 2.1 time: 0.392343 Oct 19 22:14:38.748673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1120/2248] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:14:38 2022] DELETE /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:14:38.756690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:38.760895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:38.763744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.764224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.764705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.765358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.765810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.766231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.798089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:38.800571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:38.806694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.807278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.807814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.808567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:38.809085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:38.809953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:38.841608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-88f37ede-dc6e-45df-b512-dfade170ba3d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047775 Oct 19 22:14:38.842175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1121/2249] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:14:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:38.897160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:14:38.905366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bfaec073-47e1-4131-8804-f5e4d6578e27 tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1503 microversion: 2.1 time: 0.152432 Oct 19 22:14:38.905859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1129/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:14:38 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:14:39.069570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:39.071722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:39.078149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.078631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.079095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.079775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.080231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.080654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.111288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2d9354e5-3902-4a40-af0f-e743aec8b7a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045570 Oct 19 22:14:39.111842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1122/2251] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:14:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:39.149733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:14:39.152674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:39.158636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.159074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.159504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.160180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.160627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.161045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.252872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cec51058-9668-4e91-83e7-3bfedd6cc4b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/action" status: 200 len: 76209 microversion: 2.1 time: 0.106789 Oct 19 22:14:39.253865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1130/2252] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:14:39 2022] POST /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45/action => generated 76209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:39.584422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:14:39.586670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:39.593369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.593871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.594287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.595009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.595464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.595887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.695047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8d716bee-9101-49d8-80f6-24b4deaab768 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action" status: 200 len: 82028 microversion: 2.1 time: 0.114288 Oct 19 22:14:39.704307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1123/2253] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:14:39 2022] POST /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/action => generated 82028 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:14:39.710255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:39.710971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:39.718327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.718895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.719648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.720430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.722384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.722830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.815776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lazy-loading 'services' on Instance uuid a9df3c36-da16-4a07-b4a2-c426787bd720 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:14:39.854761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:14:39.857035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:39.863974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.864457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.864893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.865587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.866048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.866472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.872588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Request method failure captured: Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments/8b4775d8-6227-4dab-a23c-e67a3d587c2f HTTP/1.1 Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHRo1PS7UqkxhsLDMBQmHme91FauqIHQALPlgVsgJCezIeniIS0JG61ErkHZZ7slIgokOv3WkCiO5HOSGPUTAAo-I4HtLvxUDiKZrJHNmfF8j2m0m431D2uphZwSSjzEpkyO4r17wctjR1erE8Td8EdLUPF4JH5JmJfyQKZuMMo6SG8 Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 6529fcc0c4c4487ab023942957692c3a Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-TestMinimumBasicScenario-707634737 Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:14:39.874882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6529fcc0c4c4487ab023942957692c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6529fcc0c4c4487ab023942957692c3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6529fcc0c4c4487ab023942957692c3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6529fcc0c4c4487ab023942957692c3a"}]}] Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-TestMinimumBasicScenario-707634737 Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 6529fcc0c4c4487ab023942957692c3a Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-TestMinimumBasicScenario-707634737 Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-TestMinimumBasicScenario-707634737-project Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 86dbc6cb1f144de9b83ccac964a1b3da Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-TestMinimumBasicScenario-707634737-project Oct 19 22:14:39.876648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'server_id': 'a9df3c36-da16-4a07-b4a2-c426787bd720', 'id': '8b4775d8-6227-4dab-a23c-e67a3d587c2f'} Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 19 22:14:39.877373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 22:14:39.878693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:39.886191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:14:39.887667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) Oct 19 22:14:39.889254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:14:39.890537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bd300c1-6e39-4ca1-a13e-15a6f7cfcd2c) {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:14:39.890537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cf76706b-c80a-4b95-ad3b-711b91f977e4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments/8b4775d8-6227-4dab-a23c-e67a3d587c2f" status: 400 len: 269 microversion: 2.1 time: 0.170511 Oct 19 22:14:39.890537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1131/2254] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:14:39 2022] DELETE /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720/os-volume_attachments/8b4775d8-6227-4dab-a23c-e67a3d587c2f => generated 269 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:14:39.931475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:39.932821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:39.947568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.948076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.948516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.950282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:39.952020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:39.952730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:39.956205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-40d88731-b92b-4568-887d-847847fd951a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/action" status: 200 len: 41126 microversion: 2.1 time: 0.106027 Oct 19 22:14:39.957656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1124/2255] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Oct 19 22:14:39 2022] POST /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2/action => generated 41126 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 22:14:40.022245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-a373f95d-e84d-4dbe-bad7-7414921cd8f0 req-fee5d8de-1720-4831-aa40-e7a201c00d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c904f6-2f26-43c8-891a-327e09b6cfef", "name": "network-vif-deleted", "tag": "9f67a5bc-0fc9-4c09-868c-0306d466fe9e"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:14:40.033704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-a373f95d-e84d-4dbe-bad7-7414921cd8f0 req-fee5d8de-1720-4831-aa40-e7a201c00d31 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:40.034260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-a373f95d-e84d-4dbe-bad7-7414921cd8f0 req-fee5d8de-1720-4831-aa40-e7a201c00d31 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:40.034700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-a373f95d-e84d-4dbe-bad7-7414921cd8f0 req-fee5d8de-1720-4831-aa40-e7a201c00d31 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:40.046210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-a373f95d-e84d-4dbe-bad7-7414921cd8f0 req-fee5d8de-1720-4831-aa40-e7a201c00d31 service nova] Creating event network-vif-deleted:9f67a5bc-0fc9-4c09-868c-0306d466fe9e for instance 01c904f6-2f26-43c8-891a-327e09b6cfef on hv-cinder-maste Oct 19 22:14:40.051429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-a373f95d-e84d-4dbe-bad7-7414921cd8f0 req-fee5d8de-1720-4831-aa40-e7a201c00d31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033660 Oct 19 22:14:40.052040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1125/2256] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:14:40.072595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:14:40.080211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f2fb0ef3-c30d-4339-94ff-b01555bcec3f tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1461 microversion: 2.1 time: 0.156258 Oct 19 22:14:40.080780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1132/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:14:39 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1461 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:14:40.124993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:14:40.127285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:40.133462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:40.133876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:40.134313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:40.135080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:40.135536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:40.135987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:40.240838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8fd076b8-4979-4ab5-81fe-b182a7c5c953 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/action" status: 200 len: 38069 microversion: 2.20 time: 0.120395 Oct 19 22:14:40.241691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1126/2258] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 19 22:14:40 2022] POST /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841/action => generated 38069 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:14:41.104140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:41.105676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:41.107229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:14:41.111988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:41.112469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:41.112923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:41.113610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:41.114064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:41.114489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:41.145692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:41.146171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:41.146606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:41.147074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lazy-loading 'fault' on Instance uuid 01c904f6-2f26-43c8-891a-327e09b6cfef {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:14:41.191880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92dd14e2eff4cc0a256708fba70c09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf0f765079a44bc9e68012054763b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:14:41.199847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-624b5a47-0dfb-4965-9f64-14fe23c1433b tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 200 len: 1303 microversion: 2.1 time: 0.100221 Oct 19 22:14:41.200487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1133/2259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:14:41 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:14:42.223301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:14:42.223992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] [instance: 01c904f6-2f26-43c8-891a-327e09b6cfef] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:14:42.231222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:42.231693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:42.232118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:42.232791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:14:42.233237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:14:42.233659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:14:42.247760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] HTTP exception thrown: Instance 01c904f6-2f26-43c8-891a-327e09b6cfef could not be found. Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Request method failure captured: Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef HTTP/1.1 Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHRodLZM7DeQy029RYqjqF7wlVQRSCfb5WOVdtEeKJGwb8wyeN-_2-25owp5RWxYStUt6wFLCcu9-q1DRTyQYHDIW5hj-yMWr3UUtUBEAT-5doMPWwLRHCYgObui7xDUuciDmTbpWxdzuBKGVRjSK3Mibxu7Rx2ZdS4IhiQj0vWXtVQ Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: bbf0f765079a44bc9e68012054763b34 Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesActionsTest-1525443205 Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:14:42.249380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbf0f765079a44bc9e68012054763b34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bbf0f765079a44bc9e68012054763b34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bbf0f765079a44bc9e68012054763b34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bbf0f765079a44bc9e68012054763b34"}]}] Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesActionsTest-1525443205 Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: bbf0f765079a44bc9e68012054763b34 Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesActionsTest-1525443205 Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesActionsTest-1525443205-project Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: e92dd14e2eff4cc0a256708fba70c09d Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesActionsTest-1525443205-project Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 01c904f6-2f26-43c8-891a-327e09b6cfef could not be found. Oct 19 22:14:42.251040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '01c904f6-2f26-43c8-891a-327e09b6cfef'} Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c904f6-2f26-43c8-891a-327e09b6cfef could not be found. Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:14:42.251977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c904f6-2f26-43c8-891a-327e09b6cfef could not be found. Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c904f6-2f26-43c8-891a-327e09b6cfef could not be found. Oct 19 22:14:42.253685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:14:42.255013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] Returning 404 to user: Instance 01c904f6-2f26-43c8-891a-327e09b6cfef could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:14:42.255013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-616d8420-3918-4bf9-a5f3-0d4d9210483d tempest-VolumesActionsTest-1525443205 tempest-VolumesActionsTest-1525443205-project] 10.222.0.20 "GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef" status: 404 len: 111 microversion: 2.1 time: 0.031658 Oct 19 22:14:42.255013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1127/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:14:42 2022] GET /compute/v2.1/servers/01c904f6-2f26-43c8-891a-327e09b6cfef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:17:46.951851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10834d57-2de5-4ec5-8d0f-11914d1788a7] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 22:17:46.953469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=3 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:17:46.954570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=58 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:17:46.955770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:17:46.955916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 (ip 10.222.0.20) !!! Oct 19 22:17:46.957988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:17:46.958123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 (ip 10.222.0.20) !!! Oct 19 22:17:46.959207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:17:46.959325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:17:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 (ip 10.222.0.20) !!! Oct 19 22:17:46.963557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:46.964181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:46.974050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:46.974529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:46.974974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:46.975661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:46.976107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:46.976527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:47.002390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:17:47.275087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-258b659d-b588-450a-a1cd-840aff6e0070 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 204 len: 0 microversion: 2.1 time: 0.324755 Oct 19 22:17:47.275666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1134/2261] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:17:46 2022] DELETE /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:17:47.282533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fed87e8-26b4-410b-8455-b08e38f2b579] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 22:17:47.283596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:17:47.284367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:17:47.286080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:17:47.286232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 (ip 10.222.0.20) !!! Oct 19 22:17:47.287443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:17:47.287562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 (ip 10.222.0.20) !!! Oct 19 22:17:47.288630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:17:47.288743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 (ip 10.222.0.20) !!! Oct 19 22:17:47.293113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:47.293728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:47.304500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:47.304992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:47.305421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:47.306114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:47.306564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:47.307044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:47.603848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:47.612457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7fded69c-2db3-4608-9dc7-27f7efe45deb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.332574 Oct 19 22:17:47.613006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1128/2262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:47 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:17:48.637612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:48.638249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:48.646886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:48.647409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:48.647847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:48.648537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:48.648994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:48.649420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:48.654799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] [10834d57-2de5-4ec5-8d0f-11914d1788a7] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36106. Oct 19 22:17:48.837563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:48.845817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f06322e3-0516-4804-93d3-f3ef2dae73ff tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.213142 Oct 19 22:17:48.846478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1135/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:48 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:49.870252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:49.872511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:49.889633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fed87e8-26b4-410b-8455-b08e38f2b579] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36130. Oct 19 22:17:49.893346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:49.893993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:49.894743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:49.895658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:49.896192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:49.896739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:50.035163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:50.041653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4721f379-8ead-42cf-b1ef-5de2c120d55c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.176444 Oct 19 22:17:50.042209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1129/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:49 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:51.064173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:51.064735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:51.071146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:51.071626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:51.072064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:51.072747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:51.073197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:51.073622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:51.198911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:51.207000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6e0fed82-ee9f-4350-939b-21c96dc7d630 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147002 Oct 19 22:17:51.207559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1136/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:51 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:52.229773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:52.230385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:52.237413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:52.237890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:52.238318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:52.239014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:52.239463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:52.239881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:52.367392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:52.375922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-909def5f-8cfb-44d9-9414-8680a7ccc3cf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149489 Oct 19 22:17:52.376491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1130/2266] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:52 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:53.399277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:53.399817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:53.406250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:53.406734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:53.407202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:53.407886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:53.408334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:53.408753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:53.540696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:53.549019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5ea8de8e-7df4-4f12-8611-180942c92f3d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153745 Oct 19 22:17:53.549580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1137/2267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:53 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:54.572513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:54.573136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:54.579582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:54.580071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:54.580502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:54.581195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:54.581646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:54.582067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:54.712008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:54.720269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-97f1b558-d5ba-435b-b7ca-b9202d063dbc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151578 Oct 19 22:17:54.720828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1131/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:54 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:17:55.743300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:55.743908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:55.750695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:55.751212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:55.751645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:55.752323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:55.752770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:55.753186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:55.880162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:55.888211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-371a72e1-5ddb-4e7b-986a-886517b915f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148714 Oct 19 22:17:55.888768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1138/2269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:55 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:56.911272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:56.911819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:56.918110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:56.918587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:56.919062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:56.919729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:56.920175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:56.920598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:57.044626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:57.052629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6750ce54-9c6e-42ce-ad94-8711dcee1071 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145319 Oct 19 22:17:57.053187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1132/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:56 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:58.076337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:58.076894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:58.083445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:58.083928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:58.084371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:58.085054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:58.085508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:58.085960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:58.215140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:58.223832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-63d68d20-b909-4b98-a80c-64cff2ddf6fb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151489 Oct 19 22:17:58.224403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1139/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:58 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:17:59.246367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:17:59.246998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:17:59.253937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:59.254419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:59.254852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:59.255563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:17:59.256012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:17:59.256432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:17:59.395014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:17:59.404935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3dd93ddb-a93f-4882-8d05-f9b5f9bdddb7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.162375 Oct 19 22:17:59.405492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1133/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:17:59 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:00.428469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:00.429085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:00.435459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:00.435942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:00.436741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:00.437343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:00.438729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:00.439183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:00.567092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:00.575167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b1949f9-3a55-4345-ba7d-d99d0c42f301 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150523 Oct 19 22:18:00.575728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1140/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:00 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:01.597844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:01.598451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:01.604770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:01.605244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:01.605673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:01.606348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:01.606793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:01.607248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:01.731666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:01.739789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6fc88d38-74ce-4261-a3be-6cc8772546c5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145745 Oct 19 22:18:01.740339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1134/2274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:01 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:02.762669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:02.763270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:02.770074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:02.770547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:02.771009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:02.771687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:02.772135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:02.772553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:02.901165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:02.909896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f4bdf7d-86f4-4184-b3c8-07e57370dae4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151066 Oct 19 22:18:02.910456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1141/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:02 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:03.932542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:03.933153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:03.940331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:03.940812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:03.941246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:03.941927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:03.942378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:03.942798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:04.066459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:04.075391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7b5f56f5-1432-4542-8a26-ac7360902b11 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146622 Oct 19 22:18:04.076692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1135/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:03 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:05.099105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:05.099714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:05.105984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:05.106466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:05.106897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:05.107598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:05.108044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:05.108463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:05.238468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:05.246576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5a5e5102-e099-4f31-b73b-3875d7c847ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151379 Oct 19 22:18:05.247166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1142/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:05 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:06.269907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:06.270557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:06.276845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:06.277319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:06.277750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:06.278426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:06.278873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:06.279316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:06.408974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:06.417149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-56a497aa-e1b7-489b-b89c-73b95212c1aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151593 Oct 19 22:18:06.417699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1136/2278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:06 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:07.441168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:07.441780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:07.448208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:07.448689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:07.449126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:07.449811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:07.450262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:07.450684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:07.576249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:07.584924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f0541bb2-3577-4a82-be84-9b066a11e30d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147911 Oct 19 22:18:07.585488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1143/2279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:07 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:08.607758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:08.608289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:08.615188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:08.615661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:08.616088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:08.616759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:08.617208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:08.617624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:08.741944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:08.749922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3f7176a2-777e-4f1c-89d2-4fc5e8e40546 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146085 Oct 19 22:18:08.750482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1137/2280] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:08 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:09.772710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:09.773349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:09.779869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:09.780349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:09.780783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:09.781957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:09.782408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:09.782830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:09.914650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:09.923599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c819b85b-2a9b-443e-83a1-99acfb79ab61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154740 Oct 19 22:18:09.935010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1144/2281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:09 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:10.947341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:10.947952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:10.954237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:10.954721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:10.955200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:10.955888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:10.956341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:10.956764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:11.097999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:11.101044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-73d67cda-b4df-46a0-9545-bdf3df7a41d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.157447 Oct 19 22:18:11.101594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1138/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:10 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:12.125465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:12.126080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:12.132475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:12.132963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:12.133400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:12.134088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:12.134542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:12.134985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:12.261926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:12.270616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d5748091-f29a-4d0f-8677-7494b5f9f98d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149920 Oct 19 22:18:12.271214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1145/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:12 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:13.293260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:13.293864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:13.300856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:13.301332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:13.301760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:13.302433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:13.302878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:13.303375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:13.431102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:13.440104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a01b7975-f722-4bb9-bac8-50264cb3b6fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150656 Oct 19 22:18:13.440656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1139/2284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:13 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:14.462724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:14.463372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:14.469819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:14.470310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:14.470756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:14.471479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:14.471936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:14.472359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:14.599375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:14.607557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18b62241-f9ae-414d-bc02-a56cb6045ff8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148692 Oct 19 22:18:14.608127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1146/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:14 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:15.631085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:15.631694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:15.637954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:15.638426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:15.638855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:15.639807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:15.640254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:15.641203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:15.774146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:15.782267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d759c31-50e0-4804-be9c-e0dd01a5fc28 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155311 Oct 19 22:18:15.783018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1140/2286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:15 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:16.804600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:16.805284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:16.811849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:16.812372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:16.812808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:16.813487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:16.814196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:16.814610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:16.942217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:16.950293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d0d07d33-ad10-4739-863f-5e2bc8168560 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149493 Oct 19 22:18:16.950870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1147/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:16 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:17.973988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:17.974800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:17.977076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=27 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:17.981844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:17.982375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:17.982813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:17.983533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:17.983987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:17.984468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:17.987117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=79 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:18.110708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:18.118715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-690c9c57-4e53-4fea-ace2-45c56a427a37 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148567 Oct 19 22:18:18.119314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1141/2288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:17 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:19.142359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:19.142998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:19.145042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:19.149707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:19.151813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:19.151813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:19.151813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:19.151813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:19.152250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:19.154767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:19.431346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:19.440041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-97612a9f-1ace-4aa7-b504-05bcd666f4b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.302187 Oct 19 22:18:19.440599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1148/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:19 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:20.463787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:20.464459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:20.471182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:20.471671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:20.472110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:20.472798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:20.473254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:20.473682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:20.622193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:20.631838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-86e317f8-421c-4f4d-aad7-a53f3a260766 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.171745 Oct 19 22:18:20.632562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1142/2290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:20 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:21.655758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:21.656367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:21.663370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:21.663855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:21.664288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:21.664977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:21.665427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:21.665856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:21.799841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:21.808004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6bd91435-7948-40d4-b15c-1bece2b7c3ac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156041 Oct 19 22:18:21.808576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1149/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:21 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:22.831473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:22.832028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:22.838482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:22.838980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:22.839427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:22.840109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:22.840563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:22.840982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:22.966586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:22.974576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6dff336c-41eb-4bb3-8ae9-bd5c844375ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147721 Oct 19 22:18:22.975152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1143/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:22 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:23.997760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:23.998372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:24.005324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:24.005802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:24.006235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:24.006916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:24.007417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:24.007853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:24.132424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:24.141224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-53861ddc-5804-4015-a799-493b067e04ed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146630 Oct 19 22:18:24.141754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1150/2293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:23 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:25.170849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:25.171481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:25.177884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:25.178362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:25.178795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:25.179502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:25.179955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:25.180374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:25.313557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:25.321909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-99a79068-e07c-44ff-870d-2c138fb6a01d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154977 Oct 19 22:18:25.322464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1144/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:25 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:26.345378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:26.345987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:26.352289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:26.352773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:26.353208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:26.353890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:26.354344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:26.354767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:26.482881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:26.491649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-56f5e83d-56bf-4a42-99ce-0dbcc9f631f1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150567 Oct 19 22:18:26.492217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1151/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:26 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:27.514151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:27.514782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:27.521113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:27.521588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:27.522023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:27.522691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:27.523163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:27.523578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:27.650939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:27.658319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5984ee5f-712d-45cd-ba94-bfd988f94a5d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147927 Oct 19 22:18:27.658882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1145/2296] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:27 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:28.682687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:28.683253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:28.690343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:28.690822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:28.691293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:28.691976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:28.692426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:28.692846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:28.819361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:28.827521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2f70b06c-06c7-4ade-bac1-c1c97ddd0d72 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148757 Oct 19 22:18:28.828741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1152/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:28 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:29.851090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:29.851698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:29.858102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:29.858579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:29.859031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:29.859707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:29.860154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:29.860571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:29.989929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:29.998293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7d41a850-db5c-44dd-a8bd-f767b26034f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151045 Oct 19 22:18:29.998989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1146/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:29 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:31.023191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:31.023812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:31.030301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:31.030788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:31.031818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:31.032516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:31.032971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:31.033395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:31.185328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:31.194387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-44142e68-d180-446f-8adf-9d4014003e40 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.176193 Oct 19 22:18:31.195054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1153/2299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:31 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:32.217424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:32.218130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:32.225442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:32.225951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:32.226382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:32.227115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:32.227563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:32.227983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:32.357443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:32.365417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d596474-7ae7-4cfc-a88c-f8ef0f2140e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151771 Oct 19 22:18:32.365973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1147/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:32 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:18:33.388815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:33.389454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:33.396496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:33.396977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:33.397410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:33.398092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:33.398543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:33.398975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:33.523361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:33.532066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ff42c68f-d7ec-42ef-a0b1-413f178cbaed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147021 Oct 19 22:18:33.532632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1154/2301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:33 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:34.555032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:34.555565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:34.561963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:34.563187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:34.563629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:34.564558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:34.565005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:34.565422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:34.688411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:34.696699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-172ad781-3e0e-47e2-89a4-f33e7bbd1777 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145576 Oct 19 22:18:34.697258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1148/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:34 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:35.720794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:35.721444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:35.727983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:35.728465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:35.728900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:35.729580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:35.730031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:35.730453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:35.858555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:35.868294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bf35314d-5667-4dfd-9f27-1902533d1c59 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151933 Oct 19 22:18:35.868870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1155/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:35 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:36.891905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:36.892480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:36.899109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:36.899593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:36.900036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:36.900721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:36.901172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:36.901626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:37.033076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:37.041296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-88abead9-fe64-476a-93cd-1d31f76355f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153940 Oct 19 22:18:37.041802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1149/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:36 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:38.065144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:38.065718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:38.072001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:38.072479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:38.072911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:38.073588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:38.074291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:38.074716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:38.209071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:38.217294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ecb95eaa-859f-4c04-8419-f0a91afed1ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.157228 Oct 19 22:18:38.217852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1156/2305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:38 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:39.353322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:39.353925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:39.360319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:39.360795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:39.361231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:39.361906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:39.362352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:39.362766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:39.487476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:39.495539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3e757124-553e-4b17-9472-d44a6578bad4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.258823 Oct 19 22:18:39.496043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1150/2306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:39 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:40.519236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:40.519844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:40.526181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:40.526654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:40.527114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:40.527791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:40.528232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:40.528646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:40.656207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:40.664235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e3e18636-b0e4-4083-bd76-980873ee20ae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149490 Oct 19 22:18:40.664924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1157/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:40 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:41.687241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:41.689878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:41.698189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:41.698743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:41.699323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:41.700154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:41.700670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:41.701094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:41.830805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:41.838836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3df99bea-6d29-4bce-b56b-ca9a2435fc70 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155415 Oct 19 22:18:41.839588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1151/2308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:41 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:42.862595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:42.863230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:42.869760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:42.870243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:42.870673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:42.871390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:42.871839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:42.872276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:43.002509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:43.010862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7243ff78-d4d6-4b53-aede-3aa1ce21f1b9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152723 Oct 19 22:18:43.011452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1158/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:42 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:44.034455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:44.035114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:44.041563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:44.042037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:44.042465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:44.043179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:44.043629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:44.044045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:44.173608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:44.182378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1dfac7b9-5d1e-4a00-958a-63e9c54050c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152424 Oct 19 22:18:44.182936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1152/2310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:44 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:45.207050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:45.207663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:45.214221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:45.214699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:45.215171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:45.215856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:45.216307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:45.216761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:45.360254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:45.369099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-13c21f75-d208-4402-aae4-04db0778b4d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.166605 Oct 19 22:18:45.369717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1159/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:45 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:46.392513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:46.393223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:46.399694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:46.400443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:46.400987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:46.401543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:46.402349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:46.402780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:46.527352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:46.535972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4641dd11-549a-4045-b79c-480f9e10a200 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147245 Oct 19 22:18:46.536528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1153/2312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:46 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:47.558423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:47.559002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:47.565638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:47.566118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:47.566554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:47.567271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:47.567728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:47.568183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:47.695459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:47.703593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b84d6d1-2629-4f38-9c8b-83fb346d9661 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149064 Oct 19 22:18:47.704159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1160/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:47 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:48.726819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:48.727457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:48.729695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=26 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:48.734234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:48.734706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:48.735170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:48.735846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:48.736289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:48.736811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:48.740767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=78 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:48.866032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:48.874320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e9ff4eb7-b53e-42cf-aa55-575c00532dd4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151241 Oct 19 22:18:48.875635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1154/2314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:48 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:49.898703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:49.899343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:49.901158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=26 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:49.905853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:49.906330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:49.906759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:49.907467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:49.907915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:49.908944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:49.911441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=78 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:18:50.042212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:50.050493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f156f3c1-01c4-4a81-bf8a-90e97e7def6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155977 Oct 19 22:18:50.051136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1161/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:49 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:51.073361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:51.073906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:51.079916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:51.081395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:51.081826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:51.082502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:51.082972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:51.083399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:51.212413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:51.220552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3ab4f2c0-dc1d-42f1-b211-d8448fbb0337 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151230 Oct 19 22:18:51.221644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1155/2316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:51 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:52.243865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:52.244476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:52.251016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:52.251503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:52.251940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:52.252659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:52.253115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:52.253543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:52.386965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:52.395206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d90bd40e-2bac-43fd-93f9-75f6505d3584 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155135 Oct 19 22:18:52.395771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1162/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:52 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:53.417812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:53.418426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:53.424860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:53.425343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:53.425775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:53.426458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:53.426912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:53.427361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:53.558612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:53.567021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2ddb9a20-ca4c-4691-8e4a-446b99971a44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152987 Oct 19 22:18:53.567596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1156/2318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:53 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:54.590913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:54.591606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:54.597965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:54.598445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:54.598879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:54.599590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:54.600041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:54.600459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:54.729122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:54.737814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4ad39bea-7f02-42b4-b1ab-d616ad0a06cc tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150797 Oct 19 22:18:54.738378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1163/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:54 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:55.760395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:55.761007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:55.767452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:55.768570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:55.769013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:55.769698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:55.770154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:55.770581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:55.896156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:55.904465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-16101820-f7c4-4a63-aeba-6fc334827ddd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147897 Oct 19 22:18:55.905028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1157/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:55 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:56.927321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:56.927927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:56.934313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:56.934789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:56.935254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:56.935932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:56.936378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:56.936795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:57.064187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:57.072583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-10cfa001-9365-4654-97f7-3997b917ad5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149085 Oct 19 22:18:57.073156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1164/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:56 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:58.095295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:58.096481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:58.103074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:58.103560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:58.103996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:58.104682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:58.105136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:58.105558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:58.231621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:58.239893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ec22283e-8ad0-4cbb-b3da-5fb96aa425c0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148449 Oct 19 22:18:58.240454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1158/2322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:58 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:18:59.262922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:18:59.263553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:18:59.270792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:59.271301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:59.271735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:59.272420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:18:59.272875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:18:59.273297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:18:59.402356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:18:59.410568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-83c75e10-6622-457f-928f-1bad06e0a802 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151569 Oct 19 22:18:59.411165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1165/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:18:59 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:00.433399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:00.433924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:00.440548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:00.441025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:00.441462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:00.442143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:00.442605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:00.443035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:00.785507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:00.793677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1c0805f1-0b81-43f9-8389-5b2a040a2a0f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.364165 Oct 19 22:19:00.794242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1159/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:00 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:01.817405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:01.818027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:01.824489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:01.825093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:01.825545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:01.826241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:01.826701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:01.827174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:01.959933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:01.968498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b0a6e1dc-91ba-4cb8-b9ef-2e32fd4db372 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155563 Oct 19 22:19:01.969069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1166/2325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:01 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:02.993340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:02.993956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:03.000343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:03.000830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:03.001266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:03.001993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:03.002449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:03.002874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:03.127941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:03.136351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-256eb5ef-c556-4463-a4f4-9ade4b300933 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146868 Oct 19 22:19:03.138680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1160/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:02 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:04.160486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:04.161100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:04.167526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:04.168015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:04.168457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:04.169195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:04.169654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:04.170086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:04.298598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:04.307523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab396a4d-471b-424e-87ef-ae8b2d860c89 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151544 Oct 19 22:19:04.308093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1167/2327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:04 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:05.331032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:05.331648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:05.337994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:05.338473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:05.338906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:05.339607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:05.340058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:05.340480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:05.472799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:05.481022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-03d943b0-8174-4854-b3f0-1fe5d3d5ec0e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154337 Oct 19 22:19:05.481576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1161/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:05 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:06.504338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:06.504948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:06.511432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:06.511917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:06.512351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:06.513036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:06.513485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:06.513902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:06.643454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:06.651798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e73a4a37-31e1-4479-b59f-d449e39a5086 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151853 Oct 19 22:19:06.652377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1168/2329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:06 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:07.676369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:07.676978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:07.683311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:07.686608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:07.686608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:07.686608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:07.686608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:07.687126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:07.814663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:07.826379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dbfd56df-4eeb-49e7-9cd7-d56f83dd4d24 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151155 Oct 19 22:19:07.826379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1162/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:07 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:08.846816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:08.847445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:08.854316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:08.854790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:08.855259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:08.855935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:08.856389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:08.856813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:08.981767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:08.989967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-55bdea52-4784-4712-bef8-e2f868eb3c05 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147548 Oct 19 22:19:08.990527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1169/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:08 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:10.013395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:10.014008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:10.020444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:10.020921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:10.021353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:10.022038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:10.022490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:10.022912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:10.155349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:10.164228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1097790b-cd2c-442a-bd1c-02d55876a7eb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154632 Oct 19 22:19:10.164797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1163/2332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:10 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:11.187612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:11.188155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:11.195341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:11.195828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:11.196269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:11.196959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:11.197415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:11.197841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:11.327359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:11.335649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-94d9936b-42f3-45ce-8361-9ad3243f24ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151964 Oct 19 22:19:11.336224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1170/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:11 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:12.358769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:12.359518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:12.365901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:12.366377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:12.366810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:12.367523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:12.367978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:12.368398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:12.494748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:12.503450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-645cc6ad-1e9a-4edb-960b-44a86bd25147 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148487 Oct 19 22:19:12.504194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1164/2334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:12 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:13.526492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:13.527137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:13.533616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:13.534102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:13.534532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:13.535238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:13.535744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:13.536162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:13.660391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:13.668597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fb7e48e9-7a79-49e9-95cc-aea8a6ef2e5a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146029 Oct 19 22:19:13.669177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1171/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:13 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:19:14.691955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:14.692482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:14.698832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:14.699645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:14.700086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:14.700759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:14.701205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:14.701622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:14.831820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:14.840019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c578d140-b4d7-4e25-a4a9-dbd320469efa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152464 Oct 19 22:19:14.840575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1165/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:14 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:15.863277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:15.863889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:15.870232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:15.870711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:15.871182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:15.871868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:15.872322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:15.872745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:16.001236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:16.009445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-90479a8e-cc40-4ef4-91d6-e903aec99de0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150636 Oct 19 22:19:16.010011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1172/2337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:15 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:17.032393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:17.033535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:17.040131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:17.040616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:17.041049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:17.041735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:17.042187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:17.042610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:17.175033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:17.183220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ef6dbf59-43ef-46d3-9a2f-4d3fc24f5a08 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154627 Oct 19 22:19:17.183783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1166/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:17 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:18.206642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:18.207279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:18.213601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:18.214073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:18.214498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:18.215208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:18.215658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:18.216071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:18.347928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:18.356122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4cc7953a-731e-4d7f-a858-f3920f916a27 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153257 Oct 19 22:19:18.356609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1173/2339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:18 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:19.383205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:19.383754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:19.386047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=26 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:19.390737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:19.391248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:19.391682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:19.395936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:19.395936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:19.395936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:19.396306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=78 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:19.520508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:19.528521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8796d027-94c5-43e8-b0c5-b86396ec25c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149150 Oct 19 22:19:19.529080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1167/2340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:19 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:20.552732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:20.553272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:20.555249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=26 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:20.559845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:20.560328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:20.560765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:20.561448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:20.561900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:20.562321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:20.564840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=78 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:20.689378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:20.697575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f9dafdf-6ae1-48e8-b81e-e5dbcef9ff44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149609 Oct 19 22:19:20.698137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1174/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:20 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:21.720281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:21.720954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:21.727048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:21.727527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:21.727957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:21.728625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:21.729074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:21.729490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:21.861922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:21.869925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-341c6d8e-fc15-45f2-a68b-2545cd3dbce9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153713 Oct 19 22:19:21.870477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1168/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:21 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:22.893827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:22.894556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:22.901183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:22.901944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:22.902282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:22.903223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:22.903673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:22.904092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:23.036049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:23.044617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1130d616-ee95-4e64-a88e-36caccaf3990 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155195 Oct 19 22:19:23.045124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1175/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:22 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:24.068217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:24.068791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:24.075216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:24.075700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:24.076132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:24.076812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:24.077264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:24.077688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:24.206836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:24.215049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa9bc746-837f-45a6-aa88-54f483c9184a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150991 Oct 19 22:19:24.218458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1169/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:24 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:25.238121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:25.238732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:25.245167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:25.245680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:25.246113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:25.246793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:25.247273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:25.247717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:25.379785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:25.388096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-71fd18e8-bd70-4895-9dd5-d6b299a3b548 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154374 Oct 19 22:19:25.388670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1176/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:25 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:26.411916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:26.412526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:26.418812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:26.419322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:26.419754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:26.420431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:26.420880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:26.421299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:26.553180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:26.561307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2ee5d93-77b0-430c-aba1-c61ddbe5ab38 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153718 Oct 19 22:19:26.561866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1170/2346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:26 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:27.584657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:27.585260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:27.592426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:27.592903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:27.593357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:27.594035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:27.594481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:27.594900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:27.726246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:27.734603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-faf4732e-1d82-49fe-af93-8261ece3c6c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153728 Oct 19 22:19:27.735276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1177/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:27 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:28.757506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:28.758026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:28.765289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:28.765769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:28.766202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:28.766882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:28.767360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:28.767784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:28.895893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:28.903927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b0a09e69-eb02-4b82-b92b-7aef40793cae tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150283 Oct 19 22:19:28.904483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1171/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:28 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:29.927490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:29.928162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:29.934371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:29.934851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:29.935316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:29.935994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:29.936441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:29.936924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:30.064998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:30.073380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-443a4f0e-c234-4716-b8b9-828763cbb0b5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149701 Oct 19 22:19:30.073942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1178/2349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:29 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:31.095833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:31.097081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:31.103675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:31.104185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:31.104620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:31.105304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:31.105754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:31.106176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:31.237463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:31.245135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d00324ff-232e-4ab9-9e2d-1a49dc3e4dcb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153109 Oct 19 22:19:31.245696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1172/2350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:31 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:32.268757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:32.269501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:32.276073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:32.276557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:32.276992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:32.277669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:32.278119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:32.278541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:32.407192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:32.415934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9dbebc4-1097-41fd-8e0f-c7a049c6a355 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151698 Oct 19 22:19:32.416701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1179/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:32 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:33.439130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:33.439661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:33.446374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:33.446851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:33.447331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:33.448014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:33.448472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:33.448893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:33.577538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:33.586236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8329c06c-7fda-4b29-b13e-3bfc08d43ab7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151150 Oct 19 22:19:33.586807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1173/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:33 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:34.609381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:34.609989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:34.616336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:34.616818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:34.617254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:34.617939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:34.618397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:34.618816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:34.749876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:34.758513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c0b74bd2-e883-40ee-9517-799326e2d765 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152976 Oct 19 22:19:34.759098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1180/2353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:34 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:35.781519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:35.782133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:35.788854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:35.789082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:35.789519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:35.790215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:35.790670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:35.791127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:35.921086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:35.929329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-626d67da-ca62-4198-a96d-8509348b33ec tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151656 Oct 19 22:19:35.929903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1174/2354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:35 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:36.952391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:36.953004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:36.959527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:36.959887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:36.960323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:36.961008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:36.961460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:36.961886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:37.089442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:37.097770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a903a56a-ddc9-4a6c-8aa7-b8fd084a549c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149152 Oct 19 22:19:37.098344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1181/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:36 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:38.120722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:38.121334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:38.127666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:38.132969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:38.132969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:38.132969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:38.132969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:38.133390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:38.263787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:38.272625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e841e4f3-d34b-4b4f-8d2b-0401bc091318 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155741 Oct 19 22:19:38.273186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1175/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:38 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:39.294704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:39.295351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:39.302294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:39.302716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:39.303187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:39.303873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:39.304357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:39.304781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:39.436384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:39.445408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62d32de2-22d2-4f53-a0a0-b5e61ce700ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154844 Oct 19 22:19:39.445977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1182/2357] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:39 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:40.468590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:40.469201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:40.476099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:40.476573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:40.477003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:40.477685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:40.478164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:40.478579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:40.606477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:40.615214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-578f01d0-2b6f-4d38-a036-98f7c828d1c6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150435 Oct 19 22:19:40.615778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1176/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:40 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:41.637720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:41.638328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:41.644704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:41.645194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:41.645630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:41.646312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:41.646764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:41.647214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:41.771633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:41.779716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bccdb727-5e57-4fb8-aca1-89e118bc2594 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145907 Oct 19 22:19:41.780281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1183/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:41 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:42.801811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:42.802418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:42.808772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:42.809255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:42.809684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:42.810361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:42.810811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:42.811267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:42.939336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:42.948570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4c3de8c2-d296-43f6-af8a-54cd16447025 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150529 Oct 19 22:19:42.949169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1177/2360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:42 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:43.973124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:43.973736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:43.980286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:43.980769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:43.981203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:43.981885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:43.982337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:43.982759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:44.109081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:44.117442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a3a65649-ee3c-45d3-b93f-b4358a82f1d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149209 Oct 19 22:19:44.118018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1184/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:43 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:45.140114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:45.148430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:45.148430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:45.148680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:45.149069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:45.149749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:45.150194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:45.150614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:45.276455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:45.284804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e6eaddb3-cc99-4fb8-971b-89ef045a751a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148543 Oct 19 22:19:45.285367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1178/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:45 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:46.307506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:46.308125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:46.314629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:46.315157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:46.315866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:46.316585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:46.317041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:46.317477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:46.448852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:46.457881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c4928eb-8f57-4809-9083-0cb5b425559b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154281 Oct 19 22:19:46.458463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1185/2363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:46 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:47.480774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:47.481332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:47.487736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:47.488275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:47.488717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:47.489407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:47.489863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:47.490289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:47.631273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:47.639438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a160e3e-8c1f-42cb-825e-aeaf0e8dd09e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.162624 Oct 19 22:19:47.639998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1179/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:47 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:48.662642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:48.663288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:48.669171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:48.669646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:48.670077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:48.670756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:48.671237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:48.671659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:48.795691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:48.803770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c88f007e-45ce-4687-831e-d3d13c513522 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145771 Oct 19 22:19:48.804340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1186/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:48 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:49.827380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:49.827982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:49.830253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=26 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:49.835539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:49.836042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:49.836474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:49.837149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:49.837596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:49.838012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:49.841841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=78 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:49.968427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:49.977642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4d061640-8307-47e3-97af-2468b27eedbf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154096 Oct 19 22:19:49.978324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1180/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:49 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:51.000529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:51.001272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:51.003612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=26 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:51.008233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:51.008715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:51.009144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:51.009828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:51.010278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:51.010696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:51.014766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=78 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:19:51.144335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:51.152818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7eeebf8b-a056-4f48-a4c4-a7a3dbe1b335 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156033 Oct 19 22:19:51.153398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1187/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:50 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:52.176585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:52.177200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:52.183560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:52.184044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:52.184511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:52.185196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:52.185647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:52.186073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:52.317261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:52.325496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b9b4678f-f5d4-455c-a458-a862a4c2b459 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153196 Oct 19 22:19:52.326058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1181/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:52 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:53.348214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:53.348803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:53.355180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:53.355662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:53.356144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:53.356776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:53.357225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:53.357648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:53.481563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:53.489616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bb41e455-b6ab-4f8a-8f58-b170d11234f2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145264 Oct 19 22:19:53.490176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1188/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:53 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:54.512814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:54.513417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:54.519804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:54.520263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:54.520689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:54.521364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:54.521809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:54.522226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:54.651558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:54.660284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4b36d28f-df61-4893-9e54-b09a504b8428 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151370 Oct 19 22:19:54.660862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1182/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:54 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:55.683584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:55.684189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:55.691077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:55.691680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:55.691986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:55.692673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:55.693132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:55.693559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:55.822976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:55.831572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b9d71f00-10b1-4bcf-b1bb-403ed840687d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151822 Oct 19 22:19:55.832128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1189/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:55 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:56.854849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:56.855491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:56.862614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:56.863123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:56.863559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:56.864237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:56.864688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:56.865104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:56.992707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:57.001029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d4a51073-92ac-454e-b7a5-eccd795586a7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149995 Oct 19 22:19:57.001590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1183/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:56 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:58.023836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:58.024444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:58.030795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:58.031239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:58.031670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:58.032344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:58.032789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:58.033214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:58.164804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:58.173214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ddf8e0d9-f3fe-4ef4-8c91-cba3bfbaf63b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153208 Oct 19 22:19:58.173796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1190/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:58 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:19:59.197519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:19:59.198245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:19:59.204908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:59.206048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:59.206488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:59.207200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:19:59.207653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:19:59.208075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:19:59.336626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:19:59.344779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ff888258-8704-4e83-8553-8c2ad625bf6b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151284 Oct 19 22:19:59.345337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1184/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:19:59 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:00.367453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:00.368110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:00.374526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:00.375039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:00.375506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:00.376196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:00.376650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:00.377073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:00.503271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:00.511470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-33c156f4-beaa-4cf9-97cc-793ca6f1ae20 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147805 Oct 19 22:20:00.512053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1191/2375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:00 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:01.535749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:01.536287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:01.542672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:01.543190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:01.543617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:01.544291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:01.544735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:01.545151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:01.674651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:01.682608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d4f3e17d-5624-4c1c-9cb6-0db2e9a93b69 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151276 Oct 19 22:20:01.683199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1185/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:01 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:02.705375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:02.706073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:02.712724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:02.713136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:02.713691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:02.714418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:02.714876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:02.715345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:02.846119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:02.854183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-42895892-b3ed-44b8-8d4c-2ebb25721404 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152662 Oct 19 22:20:02.854743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1192/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:02 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:03.877590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:03.878207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:03.884628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:03.885108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:03.885547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:03.886232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:03.886687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:03.887150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:04.012957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:04.021144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-52f8cb0f-a2e4-4aad-926d-2eb01583eeaa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147497 Oct 19 22:20:04.021700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1186/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:03 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:05.044665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:05.045198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:05.052240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:05.052723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:05.053170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:05.053901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:05.054361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:05.054844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:05.181906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:05.190089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-77b20804-c43d-4e1c-917a-08e78682c38b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149506 Oct 19 22:20:05.190718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1193/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:05 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:06.212323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:06.212933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:06.219368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:06.219842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:06.220270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:06.220970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:06.221416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:06.221841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:06.355807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:06.364329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4fb4e277-5f83-4bbe-a0dd-9fdb8eabe540 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155867 Oct 19 22:20:06.364893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1187/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:06 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:07.387635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:07.388276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:07.395270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:07.395758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:07.396204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:07.396891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:07.397348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:07.397819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:07.524862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:07.533133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-857ca66d-e03a-43c0-bd36-80551f7bd42b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149336 Oct 19 22:20:07.533702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1194/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:07 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:08.556205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:08.556840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:08.563427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:08.563902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:08.564329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:08.565006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:08.565452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:08.565870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:08.691238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:08.699374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-803166ea-fbdf-4d15-ab60-fe395764758d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147047 Oct 19 22:20:08.699945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1188/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:08 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:09.722322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:09.722934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:09.729443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:09.729930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:09.730369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:09.731090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:09.731544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:09.731966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:09.861653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:09.869727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-77bb9b95-98cd-43f3-90f0-b8aa0676821e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151284 Oct 19 22:20:09.870271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1195/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:09 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:10.892867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:10.893482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:10.899799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:10.900278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:10.900712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:10.901400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:10.901852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:10.902278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:11.032640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:11.040836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eafe0505-c1b1-452e-9486-6f09f65eb8ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151801 Oct 19 22:20:11.041400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1189/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:10 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:12.065044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:12.065557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:12.072615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:12.076526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:12.076526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:12.076526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:12.076526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:12.076946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:12.203907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:12.212725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-098d542e-73dc-4753-9277-26b8a29e8f49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152163 Oct 19 22:20:12.213293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1196/2385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:12 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:13.235540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:13.236239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:13.242773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:13.243288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:13.243723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:13.244409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:13.244857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:13.245278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:13.370484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:13.378564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ccd8ff27-1a9f-45bb-976d-fd3705c8efdd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146899 Oct 19 22:20:13.379147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1190/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:13 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:14.401589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:14.402197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:14.409037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:14.409514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:14.409940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:14.411144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:14.411626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:14.412061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:14.540482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:14.548530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b721de3d-95b6-4268-aaee-c3b6d9615471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150830 Oct 19 22:20:14.549092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1197/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:14 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:15.576904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:15.577437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:15.584260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:15.584745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:15.585163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:15.585839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:15.586281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:15.586695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:15.712292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:15.720343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2bba757-1dd7-4299-96c7-52475e9717f6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147421 Oct 19 22:20:15.720900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1191/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:15 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:16.742758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:16.743412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:16.749804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:16.750288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:16.750728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:16.751447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:16.751902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:16.752328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:16.882862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:16.891046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ce0da9cd-681b-4a07-a3c5-f2d774867471 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152680 Oct 19 22:20:16.891641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1198/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:16 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:17.914093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:17.914703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:17.921379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:17.921791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:17.922204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:17.922883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:17.923359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:17.923775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:18.053192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:18.061134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-62606ce4-a884-4c0e-ab35-a8dd0963f9e9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151112 Oct 19 22:20:18.061698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1192/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:17 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:19.084223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:19.084780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:19.091027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:19.091515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:19.091954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:19.092733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:19.093196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:19.093623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:19.225861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:19.234019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c50c6c32-8dee-4281-83c8-971c8d2563a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153911 Oct 19 22:20:19.234588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1199/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:19 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:20.257196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:20.257804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:20.259986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=26 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:20.264634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:20.265117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:20.265544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:20.266223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:20.266671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:20.267127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:20.271651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=78 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:20.401296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:20.409731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fa55edb5-b04d-427a-b861-42cd0dc8e70c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156867 Oct 19 22:20:20.410298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1193/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:20 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:21.432864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:21.433482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:21.435846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=26 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:21.440462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:21.440946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:21.441655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:21.442342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:21.442797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:21.443253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:21.447168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=78 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:21.570142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:21.578238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b7a9653e-8cb8-4bb5-b932-a2f6ff5610d4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149151 Oct 19 22:20:21.578798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1200/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:21 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:22.601174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:22.601786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:22.608150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:22.608626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:22.609089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:22.609769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:22.610219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:22.610645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:22.741285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:22.749505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bf47a84b-59e2-4770-adbe-7c818fbaf6bb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152129 Oct 19 22:20:22.750100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1194/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:22 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:23.773459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:23.774132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:23.781201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:23.781690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:23.782130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:23.782900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:23.783437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:23.783859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:23.932626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:23.940992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-81821bfe-9d47-4075-96fe-5705ce0229cd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.171601 Oct 19 22:20:23.942343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1201/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:23 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:24.964363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:24.964980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:24.971309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:24.971793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:24.972259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:24.972949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:24.973399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:24.973823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:25.100826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:25.108943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0b86800c-6c2c-48a8-b23c-a1faa1531dfe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148379 Oct 19 22:20:25.109492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1195/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:24 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:26.132120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:26.132709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:26.139169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:26.139649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:26.140087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:26.140755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:26.141202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:26.141621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:26.265441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:26.273416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7935d07f-37f6-4253-b148-3f7b59ff914d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145125 Oct 19 22:20:26.273979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1202/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:26 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:27.296546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:27.297079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:27.304199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:27.304681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:27.305119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:27.305804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:27.306261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:27.306686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:27.439273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:27.448452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6de6b689-962d-43e8-9cf5-5c1fe54c5b5f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155873 Oct 19 22:20:27.449012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1196/2398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:27 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:28.471499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:28.474831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:28.478527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:28.479015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:28.479455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:28.480140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:28.480597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:28.481015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:28.614944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:28.623075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-af693e6c-d2ed-47d6-bb78-81d0aeea74e1 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155427 Oct 19 22:20:28.623637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1203/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:28 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:29.645564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:29.646163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:29.652573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:29.653048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:29.653476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:29.654150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:29.654595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:29.655032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:29.779738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:29.787867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-076b4d16-b530-40e3-aa4c-d3001d2c77e5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146148 Oct 19 22:20:29.788446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1197/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:29 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:30.810599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:30.811242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:30.818070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:30.818555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:30.819370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:30.820071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:30.820528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:30.820959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:30.955397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:30.963727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9182c11c-96a3-4c06-80c2-8d85c8545145 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156969 Oct 19 22:20:30.964294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1204/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:30 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:31.986706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:31.987380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:31.994023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:31.994537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:31.994990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:31.995687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:31.996141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:31.996595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:32.123770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:32.132428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d5742513-8994-4f81-b803-7bf50980d186 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149583 Oct 19 22:20:32.132998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1198/2402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:31 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:33.155412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:33.156042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:33.162470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:33.162967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:33.163413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:33.164087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:33.164535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:33.164954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:33.291111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:33.299380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ded9c0e7-dbbd-4f6b-8df9-61d87cb098d2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147838 Oct 19 22:20:33.299948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1205/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:33 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:34.323704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:34.324267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:34.330654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:34.331169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:34.331605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:34.332292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:34.332743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:34.333168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:34.465237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:34.474423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a0a338e6-312b-4e1f-a32b-4e0d1364b05b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154716 Oct 19 22:20:34.474998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1199/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:34 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:35.498578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:35.499228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:35.506260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:35.506743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:35.507216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:35.507904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:35.508360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:35.508786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:35.637519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:35.646246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4a13ea36-db67-4906-a680-565082458ec9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152222 Oct 19 22:20:35.646817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1206/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:35 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:36.669728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:36.670373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:36.677253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:36.677739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:36.678180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:36.678876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:36.679367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:36.679795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:36.807414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:36.815378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-daf9778d-be94-4549-8dd5-87da7150f549 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149454 Oct 19 22:20:36.815932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1200/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:36 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:37.838512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:37.839158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:37.845581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:37.846064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:37.846500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:37.847220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:37.847671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:37.848098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:37.975081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:37.983637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9c8e983-8b80-43e3-b952-094d8abc7f8e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149008 Oct 19 22:20:37.995118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1207/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:37 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:39.006372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:39.007014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:39.013539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.014021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.014462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.015185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.015642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.016073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.146451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:39.154546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4b810d52-b67e-4554-a6c9-779e911f98ba tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152017 Oct 19 22:20:39.155132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1201/2408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:39 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:39.390335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:39.390891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:39.397726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.398218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.398649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.399600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.400059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.400479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.426365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:20:39.690620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-32c2ec2f-6e7c-4945-b608-f1548e954296 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 204 len: 0 microversion: 2.1 time: 0.303815 Oct 19 22:20:39.691431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1208/2409] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:20:39 2022] DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:20:39.699645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:39.700287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:39.705092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:39.705805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:39.706237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.706733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.707216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.707915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.708370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.708796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.712649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.713129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.713559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.714237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:39.714684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:39.715127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:39.743464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:20:39.844096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:39.853043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b81210f9-21a5-422f-9e46-2161d11e1ef6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1719 microversion: 2.1 time: 0.157166 Oct 19 22:20:39.853593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1202/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:40.010319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2c32fae5-ff97-496f-9efe-9c258f7c02f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 204 len: 0 microversion: 2.1 time: 0.309492 Oct 19 22:20:40.011043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1209/2411] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:20:39 2022] DELETE /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:20:40.019230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:40.019859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:40.026337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.026813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.027286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.027966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.028419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.028844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.155969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:40.156557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:40.158443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:40.162507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.163019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.163453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.164140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.164592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.165017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.167750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-90837a6b-2abd-4455-aefd-6bb522b9f501 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152406 Oct 19 22:20:40.168387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1203/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:40.177692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:40.178426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:40.184268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.184677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.185114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.186201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.186201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.186716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.200072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:20:40.320890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:40.329052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-36aca1e3-3ef7-4104-8e72-43267eeae313 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155405 Oct 19 22:20:40.329652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1204/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:40 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:40.471460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e137ecb3-7320-45a0-a96d-97994be6872f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 204 len: 0 microversion: 2.20 time: 0.319203 Oct 19 22:20:40.472117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1210/2414] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 19 22:20:40 2022] DELETE /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 22:20:40.481019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:40.481681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:40.487851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.490644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.490644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.490644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.490644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.491095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.743226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:40.752330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:40.753776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:40.755019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5bdcb689-c87c-480f-aeca-82670063ae32 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.277889 Oct 19 22:20:40.755752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1205/2415] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:40.827250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:40.827838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:40.834412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.834894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.835360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.836051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.836509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.836935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.862382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:20:40.865767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:40.877043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:40.877745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:40.884771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.885341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.885847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:40.886619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:40.887101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:40.887526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.094372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:41.103268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eb300511-0ab4-4f1a-bc4f-bf7f1a1b1851 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1719 microversion: 2.1 time: 0.229978 Oct 19 22:20:41.107476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-422d825d-76b7-4ecd-a02d-19a6af59c40f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 204 len: 0 microversion: 2.1 time: 0.284072 Oct 19 22:20:41.110939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1211/2416] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:20:40 2022] DELETE /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:20:41.118615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1206/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1719 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:41.122517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:41.123314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:41.132339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.141191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.141191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.141191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.141191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.141613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.191316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:41.192625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:41.198664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.199191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.199633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.200326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.200800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.201231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.269431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:41.278304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f5ea13c8-f16b-4b93-8d29-4994b35ce38d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.165728 Oct 19 22:20:41.278899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1212/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:41.352093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:41.352734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:41.358694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.359224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.359667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.360362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.361002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.361606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.454277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:41.462903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ef02eeb2-03fc-423d-b887-e29060b77ae3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.275536 Oct 19 22:20:41.463873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1207/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:41.507958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:41.523886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7efd27af-b1f5-4a79-8366-27f2f76cf272 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.176161 Oct 19 22:20:41.528357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1213/2420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:41 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:41.706711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-fc980beb-9ce1-4fa0-b807-c59abac25b71 req-98eb82b1-04b4-44e5-ae42-341f9427e923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fefc135-201b-453b-a232-37a012534b45", "name": "network-vif-deleted", "tag": "ece9340a-fd6d-4013-9113-fde159205255"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:20:41.721679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-fc980beb-9ce1-4fa0-b807-c59abac25b71 req-98eb82b1-04b4-44e5-ae42-341f9427e923 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.722196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-fc980beb-9ce1-4fa0-b807-c59abac25b71 req-98eb82b1-04b4-44e5-ae42-341f9427e923 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.722657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-fc980beb-9ce1-4fa0-b807-c59abac25b71 req-98eb82b1-04b4-44e5-ae42-341f9427e923 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.746622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-fc980beb-9ce1-4fa0-b807-c59abac25b71 req-98eb82b1-04b4-44e5-ae42-341f9427e923 service nova] Creating event network-vif-deleted:ece9340a-fd6d-4013-9113-fde159205255 for instance 8fefc135-201b-453b-a232-37a012534b45 on hv-cinder-maste Oct 19 22:20:41.755496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-fc980beb-9ce1-4fa0-b807-c59abac25b71 req-98eb82b1-04b4-44e5-ae42-341f9427e923 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114813 Oct 19 22:20:41.756088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1208/2421] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:20:41.780469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:41.781145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:41.787929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.788822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.789585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.791239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:41.791703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:41.792304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:41.928145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:41.937334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:41.939105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:41.940303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-eb2c5860-178b-4f0f-b7fa-80356d8a627e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.164070 Oct 19 22:20:41.940777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1214/2422] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:42.127621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:42.129099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:42.136623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.137559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.138242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.139186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.139871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.140400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.205524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:42.214894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a072211c-6902-4727-a4fb-62f2b3b2a366 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.092867 Oct 19 22:20:42.218281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1209/2423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:42.302408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:42.303223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:42.309568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.310310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.310738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.311654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.312105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.312521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.450556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:42.459763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d563d0dc-29f3-47cd-ba18-6de2c76a6760 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.161825 Oct 19 22:20:42.460345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1215/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:42.485786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:42.486397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:42.492605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.493100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.493530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.494215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.494738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.495101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.510196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:42.552585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:42.553130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:42.559093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.559616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.560048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.560970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.561423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.561845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.704304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:42.714671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8f3be1d7-1e43-46e2-a187-3a78e24b75a5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.166388 Oct 19 22:20:42.715702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1216/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:42 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:42.845977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:42.854941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e59a9d21-4b2b-4d60-adb2-0e9c42fd154a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.372930 Oct 19 22:20:42.855531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1210/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:42.965607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:42.966206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:42.972113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.972587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.973060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:42.973747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:42.974198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:42.974613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.102425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:43.110871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:43.112335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:43.114042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-624781f2-f898-4a1d-bf1f-0c3400e3ea31 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151743 Oct 19 22:20:43.114595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1217/2427] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:43.237656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:43.238265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:43.245082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.245559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.245991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.246667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.247146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.247567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.308822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:43.317083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3434e2af-06ef-447a-bf0a-c978164335a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082879 Oct 19 22:20:43.317669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1211/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:43.482923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:43.483548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:43.489949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.490432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.490866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.491578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.492030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.492452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.621465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:43.629690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e14876b3-72c8-4ff6-82ba-57960de3a5cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150710 Oct 19 22:20:43.630252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1218/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:43.741176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:43.741742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:43.747616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.748099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.748534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.749215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.749664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.750091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.879268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:43.879974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:43.881083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:43.886020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.886570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.887117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.887866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:43.888397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:43.888805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:43.889384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c29054b-f4bd-4687-aad0-39420bca2d85 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152711 Oct 19 22:20:43.890130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1212/2430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:43 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:44.015241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:44.024036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8653f906-638e-442c-94a8-fa25d334e8ac tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148910 Oct 19 22:20:44.024592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1219/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:44.139870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:44.140477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:44.146903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.147412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.147845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:44.148523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.148987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.149411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:44.275124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:44.283670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:44.285112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:44.286301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ca8d423-df61-4170-978b-f5b6bda0b10a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150345 Oct 19 22:20:44.286855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1213/2432] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:44.342318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:44.342931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:44.348853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.349333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.349764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:44.350443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.350891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.351340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:44.414274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:44.422416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0e989945-4db4-4376-b380-b2514822731c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084052 Oct 19 22:20:44.423002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1220/2433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:44.653529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:44.654056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:44.660025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.660502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.660932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:44.661602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.662049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.662466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:44.795153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:44.803934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6358cc15-3d0f-4774-8034-396fc6e19ee2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154404 Oct 19 22:20:44.804494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1214/2434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:44.913416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:44.913957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:44.920279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.920758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.921190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:44.921863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:44.922307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:44.922725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.046747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:45.047200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:45.049159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:45.053830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.054320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.054754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.055485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.055938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.056362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.058067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-999c6135-b279-42c3-8c45-154d138c33b2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149225 Oct 19 22:20:45.058637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1221/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:44 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:45.187346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:45.195801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9939879b-ddd8-411a-937e-917a9e744590 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152995 Oct 19 22:20:45.196364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1215/2436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:45.311725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:45.312330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:45.318419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.318898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.319365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.320048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.320499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.320923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.445079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:45.445686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:45.447560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:45.451983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.452464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.452893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.453571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.454017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.454434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.456772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:45.458915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:45.460196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-75bfb841-7fce-416d-9064-29904418084c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152401 Oct 19 22:20:45.460764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1222/2437] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:45.515334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:45.523959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8bbe5101-99ca-4ca1-9a3b-b9eaf8d21e53 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082911 Oct 19 22:20:45.524518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1216/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:45.827469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:45.828143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:45.834835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.835352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.835795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.836485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:45.836943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:45.837367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:45.967219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:45.975869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c2497f99-298e-48fd-a699-c1c225075b8e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152237 Oct 19 22:20:45.976438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1223/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:46.081471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:46.082577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:46.088408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.088881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.089309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.089977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.090421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.090856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.215947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:46.218979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:46.219601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:46.224372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-479066f2-8079-419f-86f1-8058ea941316 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147114 Oct 19 22:20:46.225042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1217/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:46 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:46.225565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.226116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.226554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.227281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.227736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.228160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.358170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:46.366385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dd728411-a062-490d-a83d-8a04647c474a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151304 Oct 19 22:20:46.366972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1224/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:46.486025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:46.486731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:46.493171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.493648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.494081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.494763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.495239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.495661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.547267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:46.547917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:46.558319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.558809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.559278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.559981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:46.560434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:46.560856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:46.623551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:46.630226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:46.633006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01f63094-47c9-4d2e-99ae-53f4f3902f85 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089689 Oct 19 22:20:46.633595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1225/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:46.638865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:46.640336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:46.641779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7b3e64e2-18a0-4019-b32c-33d45d78cc96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.159616 Oct 19 22:20:46.642331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1218/2443] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:46.999397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:47.000003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:47.006367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.006841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.007299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.008066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.008513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.008932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.138680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:47.140994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:47.147637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3a2c6832-fd8c-45c6-8d7f-479613ce754b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152288 Oct 19 22:20:47.148200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1226/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:47.247618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:47.248221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:47.254160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.254575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.255027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.255698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.256140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.256553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.386234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:47.389551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:47.390234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:47.395753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f3e60978-c697-4d8f-b959-670a522b6fe4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151808 Oct 19 22:20:47.396339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1219/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:47 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:47.397658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.398300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.398774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.399768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.400238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.400659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.527267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:47.535955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab1b2875-9ca7-4836-8cd9-e196f7d16068 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149695 Oct 19 22:20:47.536525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1227/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:47.655535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:47.656145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:47.663223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.663713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.664158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.664843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.665297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.665724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.667253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:47.667860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:47.673617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.674093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.674525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.675229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:47.675700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:47.676154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:47.732133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:47.740503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cdc70e3d-f91b-414e-b978-50a08fac6724 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088744 Oct 19 22:20:47.744081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1220/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:47.816631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:47.826416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:47.827989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:47.829180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e2536d5-b00d-49db-8e94-4ecc8c7ef4da tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.165655 Oct 19 22:20:47.829747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1228/2448] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:20:48.171492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:48.172030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:48.178453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.178944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.179384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.180060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.180505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.180923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.307565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:48.315713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fafeb77f-7a84-4743-b7d7-d4f72c13856f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148188 Oct 19 22:20:48.316278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1221/2449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:48.420388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:48.421037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:48.428151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.428577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.429017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.429705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.430164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.430589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.558063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:48.560442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:48.561056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:48.566382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4dba3f61-cb71-4b18-a1a3-9de58a839c44 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149811 Oct 19 22:20:48.567813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1229/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:48 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:48.568021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.568287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.568900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.572433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.574113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.574574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.701401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:48.709547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9ac53c57-86cc-49cb-942a-44e1f9a645df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152883 Oct 19 22:20:48.710109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1222/2451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:48.763713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:48.764337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:48.770256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.770741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.771216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.771904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.772361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.772792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.833734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:48.841619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18434694-0d8e-4385-89c8-6d7cacc58346 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081896 Oct 19 22:20:48.842186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1230/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:48.855675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:48.856688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:48.862553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.863058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.864120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.864794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:48.865236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:48.865652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:48.998188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:49.006734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:49.008255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:49.009423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1fcdbbd8-ddd7-48ba-a175-290fceb80242 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157525 Oct 19 22:20:49.009982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1223/2453] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:49.339252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:49.339806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:49.345716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.346195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.346624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.347338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.348386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.348807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.476289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:49.484418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7495990e-484d-44dd-a7df-d7e27aef4674 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149119 Oct 19 22:20:49.484977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1231/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:49.590443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:49.591016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:49.597130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.597648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.598110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.598816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.599299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.599719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.725423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:49.732806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:49.733420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:49.733662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-75764b85-899e-4991-a733-c51a7ecedf0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147094 Oct 19 22:20:49.734236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1224/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:49 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:49.739894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.740384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.740824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.741516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.741973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.742399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.864678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:49.865211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:49.868936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:49.871233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.871720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.872157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.872869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:49.873300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:49.873722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:49.877109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5ccc7c77-5f7d-4549-9686-7cf25da3f83b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148121 Oct 19 22:20:49.878773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1232/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:49.935432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:49.944334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-00c6cb8d-6145-4708-a52c-df424cb6cce5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083609 Oct 19 22:20:49.945033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1225/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:50.036761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:50.037362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:50.043353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.043833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.044267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.044951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.045396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.045819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.179980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:50.188553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:50.189983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:50.191166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-97e9696d-c50f-4e98-9bf8-8e789e9dd8f3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158946 Oct 19 22:20:50.192113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1233/2458] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:50.507386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:50.508003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:50.509878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=66 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:50.514509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.515022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.515469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.516153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.516608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.517031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.646862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:50.655066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2403deee-5c07-4524-a85c-c62d0c186b4a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151528 Oct 19 22:20:50.655629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1226/2459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:50.756839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:50.757503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:50.763911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.764386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.764816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.765489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.765934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.766353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.892962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:50.900418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:50.901052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:50.901783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5e9fa896-4640-4c45-9561-84bbf367fa71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148771 Oct 19 22:20:50.902348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1234/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:50 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:50.907191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.907676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.908111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.908798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.909356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.909782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.913709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:50.967098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:50.968092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:50.974390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.974906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.975361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:50.976055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:50.976508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:50.976959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:51.037605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:51.038625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:51.046378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-48ae377b-d832-4190-92e9-342be9add37c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083154 Oct 19 22:20:51.046677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-939bda38-a417-4fcd-9b9a-ab2b63edd71a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150075 Oct 19 22:20:51.047144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1235/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:51.047296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1227/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:51.217097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:51.217706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:51.223649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:51.224137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:51.224576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:51.225261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:51.225718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:51.226143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:51.354499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:51.363108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:51.365081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:51.366248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7a1a6312-3437-4aa4-bc42-e0c5722d8ecb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153112 Oct 19 22:20:51.366809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1236/2463] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:51.678720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:51.679308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:51.685182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:51.685656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:51.686085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:51.686757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:51.687232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:51.687649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:51.822891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:51.826976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ce53290d-a9fc-4f64-be9f-407d7afbf1fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152163 Oct 19 22:20:51.827541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1228/2464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:51.924444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:51.925055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:51.927982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:51.932695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:51.933193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:51.933630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:51.934319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:51.934771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:51.935223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.065666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:52.069638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:52.070242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:52.074203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-24f58d3b-0f49-41f6-8943-37e395e25f2f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153558 Oct 19 22:20:52.074778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1237/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:51 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:52.077165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.077646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.078074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.078758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.079228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.079365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:52.079650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.079896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:52.086274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.086769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.087229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.087926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.088379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.088807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.149229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:52.157490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-87dbed5e-2738-4009-855d-27271c71b84a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081740 Oct 19 22:20:52.158517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1238/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:52.209260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:52.217371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7e555f4c-689e-440f-8cea-0fc31a3df8c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151931 Oct 19 22:20:52.217926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1229/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:52.391196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:52.391809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:52.397801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.398288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.398724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.399440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.399898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.400331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.527911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:52.537060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:52.538515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:52.539740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8590537f-e3b6-488a-b1c6-5b683eaeeaba tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152525 Oct 19 22:20:52.540300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1239/2468] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:52.851459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:52.852076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:52.857937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.858422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.858860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.859577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:52.860032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:52.860456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:52.988197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:52.996368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-485dd823-8bba-4736-893a-7784d02cd835 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149718 Oct 19 22:20:52.996933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1230/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:53.098335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:53.098898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:53.105268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.105748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.106186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.106869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.107349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.107777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.180563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:53.181278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:53.187667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.188154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.188585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.189265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.189711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.190132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.237871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:53.247707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2c275a4e-9eba-4154-9e8a-3f6f1bce02d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153811 Oct 19 22:20:53.248411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1240/2470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:53 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:53.253119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:53.253728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:53.260127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.260622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.261062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.261768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.262221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.262644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.399071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:53.401244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:53.407452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-827de3a9-7eca-44e5-8c0b-6cb9a8b7fb67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.158051 Oct 19 22:20:53.408105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1241/2471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:53.409298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8b47e66-02da-4089-8f3e-64825d3d7417 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.233191 Oct 19 22:20:53.409849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1231/2472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:53.565506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:53.566118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:53.572870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.573354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.573793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.574486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:53.574941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:53.575389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:53.698196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:53.706705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:53.708191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:53.709355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-98399688-a959-4093-a812-29ec49aac840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.147729 Oct 19 22:20:53.709920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1242/2473] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:54.020524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:54.021137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:54.027104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.027590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.028030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.028729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.029183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.029604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.155747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:54.164215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a0632c5f-a003-45ab-ada4-787629479f4c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147586 Oct 19 22:20:54.164768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1232/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:54.271637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:54.272230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:54.278563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.279076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.279507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.280255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.281158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.281589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.296646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:54.411662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:54.420569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-241f122c-283a-490e-b070-8bde80f753a2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152659 Oct 19 22:20:54.421251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1243/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:54 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:54.431715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:54.432381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:54.433402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:54.434286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:54.440135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.440873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.441169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.441443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.442632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.443120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.443382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.443798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.443905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.444232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.444365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.444679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.516456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:54.525684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4c3ddf30-6fe9-46de-8d16-2d389e41546a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.095731 Oct 19 22:20:54.525684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1244/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:54.580054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:54.589549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f75f3e1-010e-443b-b9c0-fd55c7d7af81 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.161788 Oct 19 22:20:54.590102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1233/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:54.734581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:54.735224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:54.741805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.742294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.742737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.743452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:54.743909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:54.744333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:54.869958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:54.878554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:54.880547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:54.881752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d3a61c4a-67d7-4844-aeae-c3cc57b60420 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151155 Oct 19 22:20:54.882314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1245/2478] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:55.186843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:55.187390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:55.193589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.195670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.195670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.195670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.195670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.196102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.323080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:55.331133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c1c98786-dda7-4295-bfa4-9cf872accda2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148197 Oct 19 22:20:55.332997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1234/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:55.445946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:55.446559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:55.452998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.453489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.453942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.454612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.455097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.455525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.547279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:55.547989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:55.554706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.555225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.555665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.556363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.556820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.557241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.586121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:55.594294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-89abc146-f770-4384-873c-4044d522780c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152614 Oct 19 22:20:55.594864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1246/2480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:55 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:55.612151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:55.612753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:55.618799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:55.619937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.620434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.620877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.621573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.622030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.622455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.626881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-261b6614-77f9-4eef-a2e3-26243036de04 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083317 Oct 19 22:20:55.627471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1235/2481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:55.746582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:55.755369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4e9ce113-0cec-431f-8015-0d781ae94a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146954 Oct 19 22:20:55.755941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1247/2482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:55.907849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:55.908459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:55.914449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.914929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.915390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:55.916073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:55.916525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:55.916948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.047342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:56.054838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:56.056305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:56.057465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b1e4e1d3-3890-45b5-bd2b-f8859e1bb403 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153597 Oct 19 22:20:56.058018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1236/2483] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:20:56.354728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:56.355281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:56.361205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.361686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.362123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.362804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.363915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.364340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.486989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:56.495646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d0e4cf6c-f927-4382-9fc5-9f2548d25e72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.144883 Oct 19 22:20:56.496209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1248/2484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:56.618180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:56.618699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:56.625075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.625555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.625995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.626695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.627163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.627585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.651322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:56.651929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:56.657780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.658257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.658686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.659400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.659852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.660376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.724289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:56.732339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4ef12a4c-8d0c-43f7-902d-8563761a0551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084797 Oct 19 22:20:56.733115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1249/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:56.757864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:56.765886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aeee415a-d5cf-472b-95c3-0c754badaaf7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151631 Oct 19 22:20:56.766416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1237/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:56 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:56.778455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:56.779111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:56.785844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.786323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.786753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:56.787472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:56.787923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:56.788339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.083379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:57.083991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:57.089963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.090445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.090883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.091610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.092061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.092482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.128251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:57.136691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d89cd27c-200f-4560-a20a-8b8a17aaaa2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.362494 Oct 19 22:20:57.137299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1250/2487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:57.223265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:57.231719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:57.233160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:57.234349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bc168547-4c38-4e73-9f2b-40ebfb35e55e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154847 Oct 19 22:20:57.234898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1238/2488] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:20:57.518673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:57.519332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:57.526215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.526697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.527165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.527851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.528305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.528729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.652901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:57.661034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b2232b8-4cc8-4a33-ac12-573b99a31ef7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146249 Oct 19 22:20:57.661560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1251/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:57.755731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:57.756335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:57.762655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.763168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.763621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.764307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.764759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.765182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.791583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:57.792639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:57.798913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.799429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.800037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.800730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:57.801176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:57.801771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:57.828573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:57.837739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e8451a99-9a51-45fd-a57e-3b43e9656ec6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086251 Oct 19 22:20:57.838397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1239/2490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:57.931366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:57.939612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-600558e9-616a-4d6f-8185-0a665602f9e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153954 Oct 19 22:20:57.940180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1252/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:57 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:20:58.159575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:58.160103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:58.166078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.166553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.167002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.167680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.168126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.168545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.260660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:58.261259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:58.267108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.267588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.268043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.268723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.269168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.269580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.295743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:58.304568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3e4e7f5b-c040-4714-9c6f-9f60d587808d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148874 Oct 19 22:20:58.305132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1240/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:58.395990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:58.404616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:58.406069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:58.407238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-58267f3a-aadd-4ba7-b458-9c1906603355 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150440 Oct 19 22:20:58.407795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1253/2493] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:20:58.684103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:58.684660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:58.690505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.691004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.691434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.692896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.693354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.693786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.828527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:58.836854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6b3bc09-e143-40a5-b1fe-6d35592d13a5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.156686 Oct 19 22:20:58.837410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1241/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:58.860369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:58.860985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:58.868231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.868716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.869150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.869835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.870286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.870707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.935137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:58.944548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b8c7939e-347a-46b3-a211-9c0a9c106335 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087967 Oct 19 22:20:58.945113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1254/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:58.962718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:58.963363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:58.969269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.969749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.970180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:58.970861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:58.971344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:58.971767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.100051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:59.108580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bc3771fa-109b-4e53-b4b8-1de31bcf2d5b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149688 Oct 19 22:20:59.109152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1242/2496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:58 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:59.328484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:59.329101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:59.335670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.336160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.336600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.337287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.337740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.338166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.433543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:59.434246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:59.440200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.440759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.441265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.441957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.443196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.443628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.464010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:59.472357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab132b0f-ea31-443b-8d44-7c6807045b4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147760 Oct 19 22:20:59.473014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1255/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:20:59.568625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:59.570796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:20:59.577667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:59.579190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:20:59.580311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ee45b6e-62f8-4208-8a93-b4d29f71cc67 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150789 Oct 19 22:20:59.580859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1243/2498] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:20:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:20:59.859432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:59.859979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:59.866928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.867530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.867855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.868541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.868993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.869416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.967893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:20:59.968641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:20:59.976589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.977077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.977509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.978193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:20:59.978673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:20:59.979117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:20:59.997059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:00.005746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8d7f7e2e-0b12-4950-91d7-f2905db9272d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149674 Oct 19 22:21:00.006430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1256/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:00.045389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:00.054372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82e17c1e-6f56-4120-91b9-012f8a674e19 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.090191 Oct 19 22:21:00.054782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1244/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:20:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:00.132047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:00.132579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:00.138423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:00.138905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:00.139367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:00.140050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:00.140498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:00.140915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:00.269055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:00.277789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a86da0c1-77ab-4cf1-b2c5-7ed8076808bd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149704 Oct 19 22:21:00.278357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1257/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:00 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:00.495114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:00.495774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:00.501619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:00.502091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:00.502530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:00.503220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:00.503669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:00.504089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:00.617413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:00.618026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:00.623973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:00.624461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:00.624915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:00.625590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:00.626041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:00.626465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:00.631716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:00.639866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-522d2d5d-f569-4cf9-897e-978419cf985a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148621 Oct 19 22:21:00.640435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1245/2502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:00.751417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:00.759893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:00.761328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:00.762484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0654ab14-4077-4c0a-b69d-6986aec2f4b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149907 Oct 19 22:21:00.763061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1258/2503] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:01.029715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:01.030261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:01.036824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.037306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.037751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.038435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.038889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.039337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.076786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:01.077400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:01.084635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.085125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.085565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.086298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.086763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.087239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.149387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:01.157906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e6536019-1c0a-4b0e-9daf-3f658946ed00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084865 Oct 19 22:21:01.158508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1259/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:01.175112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:01.182861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37fcbea9-c7d7-42e5-8f62-5a4e29b4018c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.157189 Oct 19 22:21:01.183458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1246/2505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:01.301145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:01.301735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:01.307678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.308165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.308606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.309294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.309751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.310179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.312718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:01.440011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:01.448942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-915eba2a-7ad0-403b-b6c6-5d60c7a5ebe5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151685 Oct 19 22:21:01.449494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1260/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:01 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:01.662605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:01.663188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:01.669082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.669558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.669986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.670664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.671213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.671630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.788744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:01.789366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:01.795243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.795932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.796162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.796869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:01.797324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:01.797753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:01.799101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:01.807891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ac4bfb4d-5fa0-423f-ac5e-bf0a92a98d4b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149720 Oct 19 22:21:01.808451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1247/2507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:01.922005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:01.931050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:01.932500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:01.933659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e2632fd1-e5f5-4a72-b157-459a6287d014 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149493 Oct 19 22:21:01.934225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1261/2508] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:02.181964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:02.182528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:02.188424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.188906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.189339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.190020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.190471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.190894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.205524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:02.206227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:02.213275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.213875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.214307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.215032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.215484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.215902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.253693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:02.262520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-85f8ed6e-3546-47e8-9844-4629f0619755 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085313 Oct 19 22:21:02.263114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1248/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:02.345901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:02.353954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ed3ead43-a67c-4920-bdbf-da5fbae60c17 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152328 Oct 19 22:21:02.354526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1262/2510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:02.471612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:02.472231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:02.478768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.479293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.479739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.480445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.480902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.481329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.608773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:02.617415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0b3a8302-f5bf-468a-ac80-c9f1a0ff715f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149677 Oct 19 22:21:02.617971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1249/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:02 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:02.831318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:02.831931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:02.837890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.838369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.838800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.839499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.839949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.840366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.959893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:02.960531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:02.965830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:02.967566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.968058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.968490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.969182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:02.969635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:02.970056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:02.974594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7b89aea3-b8c7-4d51-9759-0bb3889650b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147129 Oct 19 22:21:02.975278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1263/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:03.098881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:03.107606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:03.109038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:03.110296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a58ed4c7-0405-490e-943a-2e6b376ef44e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154195 Oct 19 22:21:03.110777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1250/2513] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:03.288215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:03.288815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:03.295207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:03.295685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:03.296162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:03.296788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:03.297233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:03.297650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:03.360908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:03.369083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a732b5bb-e743-44be-876f-9a114b12febd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085418 Oct 19 22:21:03.369641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1264/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:03.378733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:03.379451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:03.386430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:03.386912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:03.387376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:03.388069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:03.388522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:03.388944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:03.514742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:03.523485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2461f7d0-0f42-48bb-ac3b-025fecd9cda6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148669 Oct 19 22:21:03.524047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1251/2515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:03.644129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:03.644669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:03.651200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:03.651682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:03.652115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:03.652798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:03.653251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:03.653671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:03.780913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:03.789595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f8f6f862-afac-4da7-944d-2440515dd9a9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149297 Oct 19 22:21:03.790170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1265/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:03 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:03.998027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:03.998636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:04.004592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.005104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.005539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.006220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.006671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.007124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.136178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:04.136778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:04.143682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:04.143868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.143868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.143868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.144376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.144825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.145243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.146527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1f1a2999-4112-4cf3-b5b9-ebe383a584d8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152293 Oct 19 22:21:04.147127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1252/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:04.275278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:04.283835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:04.285270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:04.287037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d6899e43-f9f5-4138-9dac-eae9fea5103e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154793 Oct 19 22:21:04.287594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1266/2518] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:04.391582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:04.392200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:04.399228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.399720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.400159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.400885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.401340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.401765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.462735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:04.470937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bc021c80-9075-4382-9802-f136b3a9a23e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083476 Oct 19 22:21:04.471532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1253/2519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:04.546415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:04.546986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:04.553648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.554132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.554572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.555412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.555872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.556377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.686140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:04.694989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-132c56ef-5c27-491e-bc59-789d590a0f5d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152693 Oct 19 22:21:04.695569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1267/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:04.813409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:04.813953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:04.820150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.820627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.821059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.821733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:04.822179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:04.822596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:04.955262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:04.963950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9458c888-41ed-48ee-bca4-2e4e94ec3481 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154477 Oct 19 22:21:04.964516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1254/2521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:04 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:05.169810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:05.170320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:05.176280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.177441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.177940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.178712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.179362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.179784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.305777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:05.312306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:05.312921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:05.314114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4a587bc-0f55-40e3-9e55-ba75b945481d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148323 Oct 19 22:21:05.314685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1268/2522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:05.319177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.319668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.320100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.320787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.321243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.321671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.447000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:05.455497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:05.456937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:05.458610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c552f906-a3fc-47ed-8cf3-bb6593e04ed1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149629 Oct 19 22:21:05.459212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1255/2523] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:05.493372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:05.493975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:05.499869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.500349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.500787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.501470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.501922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.502349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.562499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:05.570968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-af85190d-4bdb-4247-bf60-97da51801b97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081378 Oct 19 22:21:05.571531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1269/2524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:05.717595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:05.718145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:05.724724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.725208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.725648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.726337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.726795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.727251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.853630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:05.861720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-39887681-7667-4272-b7b5-08778dc81764 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147983 Oct 19 22:21:05.862289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1256/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:05.987415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:05.987972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:05.994515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.995025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.995465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:05.996154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:05.996608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:05.997031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.125908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:06.133963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ceea0be0-96d6-41b5-9f1e-a0e8fafc70f5 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150510 Oct 19 22:21:06.134535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1270/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:05 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:06.336586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:06.337114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:06.343030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.343507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.343934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.344602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.345077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.345492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.475568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:06.483715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-756f93f3-7de2-4dea-a261-48605d050a0a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151066 Oct 19 22:21:06.484282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1257/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:06.484826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:06.485506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:06.491502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.491989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.492424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.493116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.493568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.493995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.593926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:06.594469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:06.600455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.600954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.601396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.602087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.602543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.602991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.620484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:06.629316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:06.631373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:06.632543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-179722b4-f6d6-4203-b089-0f56e34b2a46 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151621 Oct 19 22:21:06.633106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1271/2528] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:06.665009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:06.673131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d0dc3666-d0e2-4ae0-930f-c0e4882e7476 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083215 Oct 19 22:21:06.673689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1258/2529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:06.885974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:06.886508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:06.892525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.893004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.893435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:06.894114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:06.894564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:06.895008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.023854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:07.031874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d76a038b-a068-4b44-9d8e-6f5dec754eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149811 Oct 19 22:21:07.032440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1272/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:07.160144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:07.160682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:07.166711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.167218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.167680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.168487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.168989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.169424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.294448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:07.303008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-03e8c694-b321-4645-92f4-0ed4b36a2d84 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146840 Oct 19 22:21:07.303569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1259/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:07 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:07.506782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:07.507416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:07.513294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.513770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.514200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.514874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.515347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.515766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.590038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:21:07.590288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 (ip 10.222.0.20) !!! Oct 19 22:21:07.592219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:21:07.592219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 (ip 10.222.0.20) !!! Oct 19 22:21:07.644897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:07.653611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c92a440a-f56a-486b-b36b-9c5afb37faf3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151166 Oct 19 22:21:07.663058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1273/2532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:07.663302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:07.663302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:07.666673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.667290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.667848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.668601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.669125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.669620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.685023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:07.696178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:07.711869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:07.711869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.711869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.711869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.712496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:07.712496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:07.712496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:07.769378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:07.777719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-46886981-fecf-4f80-89bb-9f175ac13eee tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085724 Oct 19 22:21:07.778313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1274/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:07.805981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:07.814804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:07.816250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:07.817729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-95d19954-5c05-45c2-bc8f-be946a7f81ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162564 Oct 19 22:21:07.818298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1260/2534] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:08.055222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:08.055776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:08.061783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.062266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.062703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.063415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.063873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.064298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.196262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:08.204351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2eaa9901-6d12-460c-b06e-de587776f2ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153147 Oct 19 22:21:08.204915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1275/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:08.326445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:08.326994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:08.333500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.333997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.334426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.335140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.335591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.336008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.463935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:08.472141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b693717-5950-41eb-a079-434cd9cf7ba9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149780 Oct 19 22:21:08.477060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1261/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:08 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:08.677086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:08.677652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:08.684075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.684560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.684997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.685683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.686140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.686563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.801367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:08.802064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:08.804633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:21:08.804787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:21:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 (ip 10.222.0.20) !!! Oct 19 22:21:08.805986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:21:08.806279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:21:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 (ip 10.222.0.20) !!! Oct 19 22:21:08.813568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.814060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.814497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.815218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.815676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.816099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.824795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:08.832366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:08.839699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-24138482-87dd-4524-bef1-a7a753609849 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.166527 Oct 19 22:21:08.854922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1276/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:08.854922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:08.854922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:08.854922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.855454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.855454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.855454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:08.855454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:08.855828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:08.884057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:08.892296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a8bf7a7-72cb-48bf-b777-264b6854bc11 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.094749 Oct 19 22:21:08.892873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1262/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:08.981497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:08.990981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:08.992441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:08.993606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b5869230-87b1-4752-bdcc-d2f3df2a0b84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152411 Oct 19 22:21:08.994169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1277/2539] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:09.228213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:09.228833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:09.234784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.235310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.235781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.236464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.236916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.237340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.365306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:09.373457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b8250dc3-db4d-46e1-94af-315817a57d1e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149775 Oct 19 22:21:09.374056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1263/2540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:09.496092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:09.496627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:09.502515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.503033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.503474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.504159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.504615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.505037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.633809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:09.642110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-af8f585f-84b2-47e1-9fd4-c4dedfc0b4d7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149988 Oct 19 22:21:09.642673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1278/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:09 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:09.861586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:09.862201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:09.868630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.869107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.869541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.870222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.870672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.871126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.916282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:09.916908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:09.923450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.923937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.924376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.925066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:09.925521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:09.925945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:09.988176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:09.997022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7799d867-d9da-490d-a0f5-279efacf64f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084537 Oct 19 22:21:10.000946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1279/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:10.001454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:10.010199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f12baa0d-427a-4929-9105-1bf72e3c2bb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152477 Oct 19 22:21:10.010760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1264/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:10.019673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:10.020309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:10.026241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:10.026714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:10.027180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:10.027856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:10.028305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:10.028719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:10.158584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:10.168009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:10.169451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:10.170618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7b0e9844-1190-4d03-958b-a1b5a4ecaa8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154808 Oct 19 22:21:10.171208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1280/2544] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:10.395897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:10.396661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:10.402621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:10.403166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:10.403608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:10.404294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:10.404747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:10.405176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:10.534308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:10.542511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ef2ec10f-02f1-49b9-adaf-42a9978d7749 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150574 Oct 19 22:21:10.543103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1265/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:10.669196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:10.669729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:10.676278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:10.676760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:10.677193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:10.677876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:10.678326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:10.678748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:10.806277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:10.814411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-24c7058f-00cd-40a6-8421-a3efb9b5eedb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153086 Oct 19 22:21:10.814990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1281/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:10 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:11.019708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:11.020845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:11.027394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.027710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.028139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.028816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.029261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.029677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.032608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:11.033347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:11.040335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.040816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.041252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.041940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.042396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.042820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.092736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:11.101509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ad947556-8483-457c-a6e7-231ccaa76b9e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085733 Oct 19 22:21:11.102080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1266/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:11.172719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:11.181466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a6c6637f-5b98-4537-8c72-f5a666e91966 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152779 Oct 19 22:21:11.182021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1282/2548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:11.197090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:11.197706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:11.203547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.204033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.204469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.205154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.205612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.206034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.330386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:11.339220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:11.341003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:11.342168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-863bf3b0-e962-4ec8-ace2-c094e674277c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.148953 Oct 19 22:21:11.342720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1267/2549] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:11.564876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:11.565412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:11.571633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.572116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.572551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.573232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.573681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.574101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.702468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:11.711373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e1236d99-d48e-4d6c-80bf-5919ba35e8c1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150420 Oct 19 22:21:11.711941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1283/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:11.838838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:11.839428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:11.845371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.845850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.846282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.846976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:11.847431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:11.847881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:11.976759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:11.984805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4cee8a4a-bea4-4c74-b298-75a6d5bc6723 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149926 Oct 19 22:21:11.985366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1268/2551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:11 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:12.124625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:12.125283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:12.131804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.132288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.132723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.135854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.135854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.135854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.195636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:12.203883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c57e2d11-e0dd-46ab-9ba6-ed71abc80604 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083129 Oct 19 22:21:12.204450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1284/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:12.204585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:12.205188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:12.212661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.213147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.213586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.214282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.214773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.215224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.342277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:12.350348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6748c455-bd11-4871-bac6-71eb2756727a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149718 Oct 19 22:21:12.350906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1269/2553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:12.368128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:12.368750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:12.374612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.375172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.375549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.376215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.376663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.377078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.500331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:12.509386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:12.510826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:12.512013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6ef08e48-e278-4578-9623-d5731ded9282 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.148365 Oct 19 22:21:12.512573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1285/2554] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:12.735374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:12.735991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:12.742487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.742993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.743429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.744114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:12.744567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:12.744994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:12.874606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:12.882751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4b571e2b-d807-43e9-bac5-bee2664ba3f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151279 Oct 19 22:21:12.883342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1270/2555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:13.008300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:13.008832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:13.014759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.015371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.015823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.016503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.016950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.017370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.147781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:13.155364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dae43aab-8acd-41d1-a1c4-feb531251f80 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151073 Oct 19 22:21:13.155932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1286/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:13 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:13.227555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:13.228170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:13.234463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.234944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.235407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.236090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.236541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.236964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.297686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:13.306238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f0e83023-662a-4730-8f32-4a18b1e93382 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083169 Oct 19 22:21:13.306793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1271/2557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:13.373608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:13.374210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:13.376124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:13.380895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.381375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.381804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.382512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.383111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.383406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.509688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:13.518055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c21a19e5-90ed-46dd-934a-7b0c24c3035d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148306 Oct 19 22:21:13.518619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1287/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:13.537359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:13.537992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:13.544048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.544560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.544992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.545717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.546137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.546558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.672973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:13.681437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:13.682865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:13.684039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bd2c56f6-d002-4837-845f-a3d4763dbf96 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151278 Oct 19 22:21:13.684598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1272/2559] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:13.906620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:13.907245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:13.913167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.913643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.914077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:13.914750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:13.915222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:13.915643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.046283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:14.054526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2ccb5d2d-9660-4124-a75e-ba08afe6dbdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151775 Oct 19 22:21:14.055176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1288/2560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:14.178552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:14.179700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:14.185828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.186305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.186738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.187450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.187897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.188317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.319366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:14.327526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aafe8c32-88c7-4fef-8ac7-bc4795b81509 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152928 Oct 19 22:21:14.328086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1273/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:14 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:14.330465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:14.331104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:14.337864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.338350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.338778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.339567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.340022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.340447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.402918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:14.411115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-87700d8a-613f-4fab-b5d7-a681660abe7d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084439 Oct 19 22:21:14.411684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1289/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:14.540645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:14.541253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:14.547166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.547651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.548090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.548782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.549240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.549666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.675792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:14.684477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78ca812b-ce6d-43b8-aee8-6664ed1ccd83 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147680 Oct 19 22:21:14.685040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1274/2563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:14.709534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:14.710136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:14.715974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.716448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.716879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.717553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:14.718006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:14.718425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:14.845464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:14.858024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:14.859496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:14.860664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-275a1559-4060-4933-b487-806f652e134e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155018 Oct 19 22:21:14.861670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1290/2564] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:15.077479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:15.078097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:15.084619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.085110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.085542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.086222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.086675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.087125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.217018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:15.225825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e58be94e-f515-401a-be59-f6365a8257ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152179 Oct 19 22:21:15.226379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1275/2565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:15.351212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:15.351762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:15.358189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.358674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.359151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.359845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.360327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.360768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.434119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:15.434870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:15.437220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:15.442969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.443455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.443887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.447931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.447931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.447931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.493062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:15.501331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-47ca8afe-ead0-436d-92ba-bdd2d0b2502e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154828 Oct 19 22:21:15.501903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1291/2566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:15 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:15.508746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:15.516966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-20f57632-ea7d-4f1e-af44-bceb2713fd07 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087123 Oct 19 22:21:15.517527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1276/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:15.707993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:15.708601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:15.714547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.715062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.715502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.716188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.716641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.717062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.843634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:15.851744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6e7ff956-3946-4b9c-a0c3-ee57412ed19c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147609 Oct 19 22:21:15.852306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1292/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:15.885777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:15.886333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:15.892248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.892726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.893159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.893869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:15.894318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:15.894740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:15.897902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:16.022857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:16.031239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:16.032666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:16.033818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-25f1a0f7-a684-4c29-925c-5f1b608564f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151935 Oct 19 22:21:16.034363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1277/2569] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:16.249133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:16.249740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:16.255624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.256528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.256965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:16.257654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.258101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.258522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:16.273782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:16.391724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:16.399820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-480a283e-099b-4d98-b73f-7fef604ddd6b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154597 Oct 19 22:21:16.400386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1293/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:16.524720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:16.525256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:16.531653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.532126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.532556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:16.533241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.533689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.534110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:16.540436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:16.541112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:16.546891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.547474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.547933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:16.548645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.549092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.549514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:16.618171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:16.620147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7b198bb8-860c-4205-8432-98d3c6abc767 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084803 Oct 19 22:21:16.620715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1294/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:16.667612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:16.675730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-704098f3-0230-47b6-87c8-d0f65811df8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154948 Oct 19 22:21:16.676293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1278/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:16 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:16.873640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:16.874242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:16.880978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.881459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.881890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:16.882573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:16.883038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:16.883456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.008030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:17.016149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-377975ad-0b3e-4ca4-939f-dd235f967dcb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146362 Oct 19 22:21:17.016718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1295/2573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:17.058449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:17.059016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:17.064858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.065341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.065776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.066458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.066910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.068155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.194483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:17.203007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:17.204450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:17.205610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d12076fe-0854-444d-827c-19dc233423b5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151080 Oct 19 22:21:17.206163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1279/2574] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:17.423852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:17.424497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:17.431515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.431997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.432434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.433117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.433576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.434000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.562400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:17.570787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8ac35a4a-1c8f-46f9-b7a4-a8e542ab9f21 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150824 Oct 19 22:21:17.571377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1296/2575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:17.644275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:17.644827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:17.651767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.652254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.652693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.653378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.653835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.654261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.704362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:17.704974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:17.711398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.711912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.712729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.713019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:17.713472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:17.713895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:17.715770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:17.724505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74e225cf-bc10-4d88-87c3-5c5fd8298bbc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084151 Oct 19 22:21:17.725205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1280/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:17.843492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:17.852241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f04d9973-9de6-4588-99b7-a9232e100cac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151775 Oct 19 22:21:17.852813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1297/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:17 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:18.040185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:18.040799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:18.046725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.047241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.047675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.048356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.048809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.049231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.179828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:18.187811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c585dcb8-83fe-4136-abce-cf2df48b34df tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152074 Oct 19 22:21:18.188372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1281/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:18.231773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:18.232315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:18.238112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.238583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.239098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.239796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.240244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.240662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.369906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:18.378424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:18.379909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:18.381075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5c786a87-4a70-436a-adf2-671218249891 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153280 Oct 19 22:21:18.381639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1298/2579] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:18.593769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:18.594381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:18.601061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.601497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.601948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.602637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.603117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.603541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.760897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:18.761583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:18.767508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.767990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.768428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.769123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.769581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.770007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.826546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:18.835464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bd90badd-f291-4791-a3a5-26a457b30381 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.245629 Oct 19 22:21:18.841283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1282/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:18.842859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:18.851285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-43638647-ee71-404b-a8e5-788d390e94a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.094472 Oct 19 22:21:18.851856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1299/2581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:18.875140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:18.875759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:18.882232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.882704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.883170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:18.883844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:18.884326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:18.884917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.094548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:19.103709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4e445286-dd7e-44be-8c42-396f791d28ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.232344 Oct 19 22:21:19.104288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1283/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:18 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:19.211646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:19.212258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:19.218063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.218547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.218997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.219682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.220132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.220554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.346292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:19.354458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-210dcca3-84ff-4685-b400-679034f862e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147329 Oct 19 22:21:19.355050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1300/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:19.406799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:19.407432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:19.413599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.414289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.414721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.415432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.415879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.416295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.542647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:19.551236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:19.553294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:19.554478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d44e6c6b-b811-4867-9db0-e28b1a5df782 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151504 Oct 19 22:21:19.555090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1284/2584] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:19.858982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:19.859536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:19.865969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.866451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.866886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.867605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.868058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.868486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.874947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:19.875642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:19.881979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.882453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.882883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.883586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:19.884032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:19.884448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:19.949307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:19.958172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-85e1c151-6624-4edc-a7ce-3a21cc314df9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086423 Oct 19 22:21:19.958754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1285/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:20.001669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:20.009781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8dcd5bdb-8ec5-4002-94b4-a80d21e32795 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154774 Oct 19 22:21:20.010340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1301/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:20.127500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:20.128022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:20.134861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.135366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.135827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:20.136552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.137002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.137424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:20.264278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:20.273106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-148ca7f9-1d7d-4a40-9c3d-c98795cb0eaf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149643 Oct 19 22:21:20.273746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1286/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:20 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:20.377392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:20.378050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:20.384024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.384510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.384944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:20.385623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.386075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.386496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:20.512958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:20.521129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5af03f88-8cc3-469d-b7dd-3c611c1b4e74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147544 Oct 19 22:21:20.521693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1302/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:20.580490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:20.581094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:20.587060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.587535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.587963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:20.588641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.589086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.589500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:20.720759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:20.729364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:20.731084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:20.732230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b633fc46-b73f-4148-9926-4bceaa7194df tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155644 Oct 19 22:21:20.732782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1287/2589] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:20.980576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:20.981176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:20.987650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.988127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.988560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:20.989846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:20.990300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:20.990720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.032879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:21.033783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:21.040497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.040981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.041415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.042103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.042552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.043001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.052001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:21.060162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-44ec839d-9a10-48d8-a3f9-823e45d69b44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083419 Oct 19 22:21:21.061127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1303/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:21.169583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:21.178285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4a0139e2-c32c-4a34-9cb6-40ef4b2e1a6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149258 Oct 19 22:21:21.178848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1288/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:21.296049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:21.296593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:21.302615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.303133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.303580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.304268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.304723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.305150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.432701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:21.441113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a09e811a-1356-4e54-acdd-3f3c7fc4242a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149023 Oct 19 22:21:21.441685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1304/2592] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:21 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:21.544102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:21.544706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:21.550683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.551141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.552074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.552770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.553217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.553636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.677363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:21.685378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ac51c2fa-e156-4e53-b9e7-f935c32bb915 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145170 Oct 19 22:21:21.685934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1289/2593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:21.757694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:21.758336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:21.764353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.764835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.765283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.765971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:21.766426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:21.766852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:21.893676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:21.902223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:21.903706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:21.904867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4549ad1c-fa61-43c7-8f5c-d3f437a98e36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151064 Oct 19 22:21:21.905425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1305/2594] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:22.084069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:22.084670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:22.091393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.091883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.092325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.093127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.093562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.093962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.159411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:22.168309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-95aa7b9a-d723-475a-9e88-42e2d733fc2f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088685 Oct 19 22:21:22.168869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1290/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:22.201501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:22.202156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:22.209338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.209813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.210242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.210975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.211422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.211839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.342260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:22.351419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d3f5ea1-a14d-407d-8200-27bb1c64aea6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153615 Oct 19 22:21:22.351928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1306/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:22.464760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:22.465368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:22.471440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.471916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.472339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.473010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.473969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.474383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.598874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:22.607151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-63fe04ef-e58f-4f87-8123-461d09ac3ad6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146108 Oct 19 22:21:22.607645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1291/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:22 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:22.708907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:22.709513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:22.715419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.715902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.716333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.717023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.717471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.717893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.844806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:22.854342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c8835350-24f3-45da-a95a-ca6e4123783c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149889 Oct 19 22:21:22.854910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1307/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:22.931169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:22.931698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:22.937560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.938034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.938459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:22.939177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:22.939620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:22.940045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.064864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:23.074092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:23.075554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:23.076706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-70961b83-7ee6-498f-9dd5-ef68ca326675 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150120 Oct 19 22:21:23.077410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1292/2599] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:23.190738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:23.191301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:23.197536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.198016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.198451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.199161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.199612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.200039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.261116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:23.269243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a50625da-21ef-40df-bc2a-b169f66ae534 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082451 Oct 19 22:21:23.269806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1308/2600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:23.374913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:23.375542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:23.381778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.382251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.382678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.383371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.383818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.384234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.513144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:23.515376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:23.522347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-af00545a-4f1a-4d2b-884a-e8f5f4b9b23e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151229 Oct 19 22:21:23.522907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1293/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:23.629462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:23.630074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:23.636090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.636571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.637007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.637687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.638138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.638558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.769654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:23.778231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e319e86-0026-4a2d-9da7-ae6d90724364 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152575 Oct 19 22:21:23.778805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1309/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:23 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:23.877862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:23.878478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:23.884642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.885424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.885870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:23.886560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:23.887039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:23.887494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.015983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:24.024186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-57fb39cb-5540-4d87-af88-ebe623a7bf98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150544 Oct 19 22:21:24.024730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1294/2603] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:24.102253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:24.102944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:24.108939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.109444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.109880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.110568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.111052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.111477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.115993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:24.242688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:24.251638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:24.253081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:24.254294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9db8ac9d-4f35-46fa-8c0c-bd494ffb3336 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156603 Oct 19 22:21:24.255488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1310/2604] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:24.291929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:24.292551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:24.298456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.298940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.299413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.300103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.300561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.300989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.364574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:24.372370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a43617ec-afe1-45f7-a3af-94be8e5ed872 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084303 Oct 19 22:21:24.373022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1295/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:24.551456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:24.552062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:24.557923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.558400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.558831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.559537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.559984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.560402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.687187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:24.696032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fe245a17-a213-4b64-85a8-f8ddffd8cdb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148526 Oct 19 22:21:24.696599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1311/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:24.801552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:24.802103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:24.808525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.809008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.809444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.810129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:24.810579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:24.811035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:24.940533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:24.949347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e0022c0d-2447-4958-9eec-53b3a8f145f9 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151683 Oct 19 22:21:24.949908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1296/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:24 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:25.047686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:25.048289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:25.054961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.055411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.055841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.056515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.056958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.057376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.190604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:25.199961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-19fc9071-40e6-4ec9-9b63-27476783a680 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.156176 Oct 19 22:21:25.200529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1312/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:25.280510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:25.281144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:25.287144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.287627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.288059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.288742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.289193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.289614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.394804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:25.396251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:25.402520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.403024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.403457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.404134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.404588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.404991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.417511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:25.426305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:25.427809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:25.428999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-21e4c21f-d32b-4953-b83d-4b864bfe23f6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152434 Oct 19 22:21:25.429558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1297/2609] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:25.466746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:25.475573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-49aa6a12-310a-437d-8bbe-7095d3a86876 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084623 Oct 19 22:21:25.476142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1313/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:25.719791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:25.720402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:25.727016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.727505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.727938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.728615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.729065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.729485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.859072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:25.867239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-af723aff-045c-4c22-8de2-4cf3f0718092 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151234 Oct 19 22:21:25.867795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1298/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:25.973159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:25.974280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:25.980256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.980740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.981173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:25.981860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:25.982319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:25.982741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.109555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:26.117678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b44692f-c259-4a15-ac0f-55a1e53dfc23 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148613 Oct 19 22:21:26.118248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1314/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:25 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:26.225654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:26.226192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:26.232323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.232817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.233281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.233968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.234422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.234850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.360103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:26.368180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-511b28d0-5219-49de-be81-5c00c5da73e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146348 Oct 19 22:21:26.368721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1299/2613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:26.454827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:26.455462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:26.462427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.462910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.463375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.464064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.464515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.464940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.498975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:26.499609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:26.506184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.506749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.507221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.507909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.508366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.508789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.571365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:26.579569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6cbd3776-3793-4c01-95b6-170310666031 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084466 Oct 19 22:21:26.580139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1300/2614] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:26.592104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:26.600840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:26.602311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:26.603517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-498adc7c-b953-46b5-bfe9-da3a15ec888a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152557 Oct 19 22:21:26.604077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1315/2615] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:26.890282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:26.890893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:26.897465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.897945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.898378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:26.899084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:26.899535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:26.899958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.030037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:27.038768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-73f09914-1782-47d5-b2a4-a95bdc746392 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152328 Oct 19 22:21:27.039302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1301/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:27.140744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:27.148064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:27.148064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.148064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.148385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.148924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.149376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.149798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.275509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:27.283625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ef16616a-8054-4814-aa93-d8e07e61162e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146745 Oct 19 22:21:27.284184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1316/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:27 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:27.391365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:27.391958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:27.398357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.398837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.399310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.399990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.400439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.400866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.524840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:27.532909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d79612f3-d369-4c7c-a889-a328e08af21e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145444 Oct 19 22:21:27.533474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1302/2618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:27.602130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:27.602730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:27.609100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.609574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.610004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.610677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.611151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.611569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.629573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:27.630181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:27.636036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.636520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.636954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.637751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:27.638209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:27.638632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:27.745493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:27.745493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8026e5fe-964d-448d-870a-83d518e6af00 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087773 Oct 19 22:21:27.745493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1317/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:27.772941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:27.781479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:27.782913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:27.784103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-01c75b53-0ab8-4334-ac02-432c6ce2e9dd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158412 Oct 19 22:21:27.784767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1303/2620] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:21:28.062075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:28.062713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:28.069065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.069538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.069965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.070667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.071139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.071560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.198278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:28.206356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f7ed95f7-e0c1-413d-b1dc-664523708626 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148108 Oct 19 22:21:28.206946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1318/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:28.306882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:28.307460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:28.313834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.314313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.314750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.315472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.315925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.316344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.441677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:28.450829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9bf86fe8-277e-4a25-a0a7-1c15a2bdb7c7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147830 Oct 19 22:21:28.451429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1304/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:28 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:28.557139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:28.557670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:28.563786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.564261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.564691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.565363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.565809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.566226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.692624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:28.700903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1d235c52-fbb5-4ba5-9691-2891009f3d8a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148231 Oct 19 22:21:28.701472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1319/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:28.709571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:28.710183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:28.716115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.716597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.717032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.717715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.718167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.718618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.784191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:28.792936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-64680d69-2489-4c05-a267-d402f8eeaf8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087766 Oct 19 22:21:28.793507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1305/2624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:28.809534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:28.810075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:28.815992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.816453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.816910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.817553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:28.818262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:28.818678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:28.951490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:28.960567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:28.962004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:28.963200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b5ec7aa-3140-48ed-b10b-d74543463d54 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157515 Oct 19 22:21:28.963757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1320/2625] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:29.230203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:29.230866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:29.236846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.237332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.237768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.238455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.239549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.239980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.368230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:29.376418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d3d1c249-31ec-42c6-acdb-5134b047e2d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150032 Oct 19 22:21:29.376984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1306/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:29.474763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:29.475467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:29.481495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.481918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.482352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.483055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.483508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.483933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.610583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:29.619142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-82bf91c3-e930-46f1-8ff2-2c3d597495c3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148789 Oct 19 22:21:29.619905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1321/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:29 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:29.724659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:29.725278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:29.731229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.731752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.732134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.732806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.733253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.733668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.815470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:29.816081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:29.822695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.823211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.823645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.824334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.824787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.825210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.859867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:29.868268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19407b62-fdcd-4990-8511-39eeb9baa601 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147961 Oct 19 22:21:29.868840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1307/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:29.885927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:29.894066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5769e4c4-72c2-471a-b555-71f7931c5f79 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082390 Oct 19 22:21:29.894623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1322/2629] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:29.989759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:29.990311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:29.996357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.996833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.997267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:29.997951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:29.998402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:29.998825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.127568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:30.136386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:30.140881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:30.140881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-846f1ab7-8275-436d-aefb-4c320aea34bc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153807 Oct 19 22:21:30.140881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1308/2630] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:30.399589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:30.400122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:30.406223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.406712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.407180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.407916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.408368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.408792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.536237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:30.544748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6ec1bba2-e24e-441a-9130-42ad3b8aa3bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149172 Oct 19 22:21:30.545316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1323/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:30.642602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:30.643231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:30.650649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.651147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.651589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.652281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.652765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.653220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.779563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:30.787821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d46e050-e845-4c8d-af0a-438d9eb99653 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149340 Oct 19 22:21:30.788681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1309/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:30 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:30.891611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:30.892217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:30.899162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.899637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.900071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.900802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.901191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.901607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.917528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:30.918245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:30.924412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.924903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.925343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.926047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:30.926505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:30.927023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:30.942411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:30.990286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:30.998620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-69d650fa-2150-4dc2-b9ef-47e81c50d271 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085101 Oct 19 22:21:30.999221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1310/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:31.031715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:31.040106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c2ee7d46-ba22-455f-8074-b713acf1b738 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152300 Oct 19 22:21:31.040669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1324/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:31.165229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:31.165755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:31.171784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:31.175609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:31.175609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:31.175609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:31.175609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:31.176012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:31.303332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:31.311694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:31.313116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:31.314258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2753b9b9-8280-4eb8-994d-d3a8b407a542 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153002 Oct 19 22:21:31.314811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1311/2635] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:31.567409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:31.568278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:31.574356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:31.574833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:31.575292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:31.575965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:31.576412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:31.576826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:31.708335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:31.716607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5fff8218-b18b-4f8d-bd3f-c728bb7d9093 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153042 Oct 19 22:21:31.717166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1325/2636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:31.810620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:31.811260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:31.818561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:31.818991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:31.819427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:31.820108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:31.820559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:31.820980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:31.944809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:31.952864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a1e1b3ac-5ac3-4e09-8bf3-821fb1e48fbd tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146074 Oct 19 22:21:31.953433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1312/2637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:31 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:32.022668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:32.023301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:32.029642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.030124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.030557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.031265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.031722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.032144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.063288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:32.067715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:32.070673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.071133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.071571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.072292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.072766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.073171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.095081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:32.097326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:32.104086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d75f51a3-ba3a-494f-b31a-f068d5e3e5d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085701 Oct 19 22:21:32.104667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1326/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:32.201684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:32.210390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-48e0bbc4-4e90-4169-98b1-1d7faf2aa8a6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150883 Oct 19 22:21:32.210970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1313/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:32.340139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:32.340782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:32.346739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.347246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.347676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.348853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.349296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.349710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.475164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:32.483583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:32.485055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:32.486307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1adfca3a-ad55-4ef1-ba34-61ee46703adc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150460 Oct 19 22:21:32.486872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1327/2640] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:32.739346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:32.739966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:32.749885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.750368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.750801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.751915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.752373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.752800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.881369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:32.889362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b87d107d-eb22-4e9d-8879-a7b980441046 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153888 Oct 19 22:21:32.889915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1314/2641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:32.976074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:32.976661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:32.982521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.983020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.983451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:32.984121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:32.984564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:32.984977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.115729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:33.123904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-358666c4-d291-4c2c-a6e0-072341c70965 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151609 Oct 19 22:21:33.124461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1328/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:32 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:33.127359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:33.127972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:33.133890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.134375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.134851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.135563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.136044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.136472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.197262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:33.205431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-935df6ea-1d87-4dab-a41d-aa15d7e75053 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082304 Oct 19 22:21:33.206001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1315/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:33.234168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:33.234775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:33.241259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.241740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.242174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.242858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.243338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.243762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.369262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:33.377507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3a501e7d-8a15-46a5-8be9-19d2a26bbe9c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147137 Oct 19 22:21:33.378077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1329/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:33.511589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:33.512220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:33.518196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.518675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.519139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.519824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.520276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.520725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.648749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:33.657164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:33.658596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:33.659777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9a8e4fd-fa54-43c7-beea-e2c5e6bf23ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152064 Oct 19 22:21:33.660358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1316/2645] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:33.913493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:33.914078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:33.920064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.920548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.920988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:33.921672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:33.922128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:33.922555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.051195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:34.059362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d923d683-43d8-47da-932d-df1c4b5e4342 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150280 Oct 19 22:21:34.059906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1330/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:34.147051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:34.147665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:34.154126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.154605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.155064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.155757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.156205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.156629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.228523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:34.229127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:34.235610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.235895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.236331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.237028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.237494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.237900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.286208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:34.294455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-634ebf4f-cafa-4be5-9b78-b22376911d12 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151777 Oct 19 22:21:34.295056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1317/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:34 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:34.299844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:34.308611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fda20519-4099-4366-b870-c36dc623e45c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083959 Oct 19 22:21:34.309166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1331/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:34.401189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:34.401793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:34.407776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.408261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.408697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.409385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.409839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.410301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.536629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:34.544768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1aabfda2-dcf8-4900-8c69-0485cb7033e9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147427 Oct 19 22:21:34.545353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1318/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:34.686310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:34.686907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:34.693193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.693669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.694137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.694773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:34.695250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:34.695663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:34.826783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:34.837160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:34.838613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:34.839816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a8ab2bfd-78ec-4226-a87e-6c4cefe75532 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157439 Oct 19 22:21:34.840381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1332/2650] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:35.084410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:35.084973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:35.093461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.093944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.094373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.095086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.095535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.095958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.318641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:35.319284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:35.326067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.326591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.327087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.329848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.330310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.330736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.490078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:35.498032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:35.498640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ba40bb83-41ef-439d-9fe6-aa29f1f6a475 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.184696 Oct 19 22:21:35.499251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1333/2651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:35 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:35.503674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:35.504286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:35.507429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bf49fdb0-0b57-4665-a2d7-8d969b44214a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.427554 Oct 19 22:21:35.508001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1319/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:35.510910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.511436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.511875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.512593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.513020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.513445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.574791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:35.576275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:35.576956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:35.582895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.583187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-52e61446-fdf7-4446-8fbf-2d99801bdb64 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082956 Oct 19 22:21:35.583473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.583758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1334/2653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:35.583912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.584595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.585045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.585459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.710225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:35.718190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a9b612df-ce69-464e-bd9c-5ae0e2e3ee70 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146334 Oct 19 22:21:35.718744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1320/2654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:35.865674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:35.866294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:35.872404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.872883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.873317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:35.873996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:35.874447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:35.874865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.001636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:36.010246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:36.011741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:36.013384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dd8e947b-139f-47af-a798-b9bd111cdb17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151625 Oct 19 22:21:36.013944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1335/2655] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:36.522828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:36.523465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:36.529821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.530296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.530634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:36.531103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.531302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:36.531432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.531845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.532260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.538190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.538668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.539137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.539824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.540274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.540695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.666256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:36.672203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:36.674973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9147cfd9-6d41-4cc7-a470-3c8c1051f3ea tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156453 Oct 19 22:21:36.675543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1321/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:36 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:36.680947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:36.681562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:36.683621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d4c4b75-a5c7-4cf1-a62a-2c5657e180dc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.156717 Oct 19 22:21:36.684696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1336/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:36.687593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.688079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.688513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.689204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.689656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.690080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.741328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:36.742623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:36.743899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:36.748796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.749279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.749711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.750027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:36.750398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:36.750847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:36.751292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:36.758868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09336db9-afd4-44c5-a455-148f976a8558 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082353 Oct 19 22:21:36.759471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1322/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:36.879017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:36.887581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ebe9fdaf-24ec-4c27-b59b-834c2972461c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150605 Oct 19 22:21:36.888150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1337/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:37.038909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:37.039467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:37.045313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.045789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.046600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.047299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.047744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.048162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.174463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:37.183069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:37.184523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:37.185683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c0eb3b3b-884e-4b54-b1bd-e15a3f7b19b0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150874 Oct 19 22:21:37.186244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1323/2660] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:37.699671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:37.700318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:37.706875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.707126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:37.708055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.708328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.708448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:37.709020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.709474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.709905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.714913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.715434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.715871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.716566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.717018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.717466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.844359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:37.853363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-271c5b70-6e54-4d5a-bdb0-95d43493005d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.157537 Oct 19 22:21:37.853943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1338/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:37 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:37.858465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:37.859186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:37.861892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:37.865168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.865493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.869289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.869289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.869289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.869289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.870586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-261a2031-8c3c-4a42-bf1e-2b71ba5751f4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.167222 Oct 19 22:21:37.871268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1324/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:37.912180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:37.912787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:37.919138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.919614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.920039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.920726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:37.921202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:37.921623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:37.929087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:37.937290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa620c8c-fe53-4519-b62c-163ae5ecc3d2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082374 Oct 19 22:21:37.937851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1339/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:38.049464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:38.057533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b85df52a-55b0-4418-ae58-79205302103d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150352 Oct 19 22:21:38.058077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1325/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:38.211913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:38.212524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:38.218461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:38.218882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:38.219352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:38.220031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:38.220484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:38.220904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:38.346369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:38.354894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:38.356372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:38.357528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c0b387cb-f9ed-46fe-bbaf-89be62cb3219 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150179 Oct 19 22:21:38.358086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1340/2665] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:38.876906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:38.877522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:38.879830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:38.884480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:38.884969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:38.885405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:38.886087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:38.886537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:38.886981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:38.893904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:38.894550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:38.901033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:38.901519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:38.901957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:38.902649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:38.903421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:38.903544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:39.019352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:39.028036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7779bade-a765-45f3-bca0-34c0d8bcde1a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155044 Oct 19 22:21:39.028601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1326/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:38 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:39.032926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:39.033527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:39.039190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:39.039601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:39.040033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:39.040722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:39.041171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:39.041587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:39.044456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:39.045644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:39.052862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e4c9674b-fa07-4cfa-a2fc-c7d29347a810 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.162741 Oct 19 22:21:39.059373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1341/2667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:39.081115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:39.081837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:39.088614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:39.089103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:39.089570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:39.090267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:39.090722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:39.091184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:39.105957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:39.114230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6474cbc0-0c51-48fe-8b28-e6b212cb6ce7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084669 Oct 19 22:21:39.114801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1327/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:39.217122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:39.225699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6eca0dcc-6666-465e-a937-9b77a866e20b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148384 Oct 19 22:21:39.226263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1342/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:39.382672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:39.383255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:39.389237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:39.389746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:39.390185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:39.390871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:39.391352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:39.391776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:39.517355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:39.526281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:39.527751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:39.528913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-92be3692-5322-45af-b70c-da06dfc39f9d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150160 Oct 19 22:21:39.529477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1328/2670] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:40.051980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:40.052528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:40.059105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.059582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.060008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.060723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.061168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.061582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.077265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:40.081588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:40.082257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:40.088689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.089209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.089754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.090484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.090937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.091384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.199171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:40.206991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-57352fbf-8f1e-4625-b3f1-71572355c049 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.159421 Oct 19 22:21:40.208089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1343/2671] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:40 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:40.212693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:40.213527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:40.220820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.221321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.221765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.222458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.222918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.223922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.227106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:40.235410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-71865631-60b0-47be-9708-7ec93759fb04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.157688 Oct 19 22:21:40.235989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1329/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:40.247868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:40.248508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:40.254410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.254895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.255391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.256082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.256537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.256959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.288318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:40.296568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7659e889-be81-42c4-ab5c-47baeb1cfc8a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087350 Oct 19 22:21:40.297745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1344/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:40.383069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:40.391288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b3afaf2d-2e2e-4f7a-b5aa-ebbabadacf30 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147013 Oct 19 22:21:40.391852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1330/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:40.555857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:40.556466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:40.562417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.562901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.563369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.564055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:40.564511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:40.564938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:40.690790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:40.699589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:40.701035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:40.702191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-552db7f8-90d3-4421-bdfd-a54e472706dc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150885 Oct 19 22:21:40.702760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1345/2675] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:41.232529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:41.233135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:41.240296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.240771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.241209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.241885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.242338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.242756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.258625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:41.259326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:41.265779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.266262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.266698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.267459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.267880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.268302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.377388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:41.385658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-99200818-de6f-45b8-bc3a-515622863a3e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156970 Oct 19 22:21:41.386226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1331/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:41 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:41.395214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:41.395214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:41.397306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.397798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.398235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.398933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.399406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.399829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.403898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:41.412648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2ce7d084-9982-4611-a1d3-4f07a0365c40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.157797 Oct 19 22:21:41.423202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1346/2677] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:41.423202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:41.423202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:41.424007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.424564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.425072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.425828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.427163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.427672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.463512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:41.471723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ae49c4ac-e642-4795-bbed-4d2ca28386c2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084451 Oct 19 22:21:41.472295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1332/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:41.554923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:41.563012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-033931e5-a565-4093-a6ac-83d40084589e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148752 Oct 19 22:21:41.563580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1347/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:41.728424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:41.729055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:41.734926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.735435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.735864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.736540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:41.736986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:41.737402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:41.864260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:41.872802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:41.874278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:41.875473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cd11ea8e-1b9e-40f4-b185-8f7232aa09a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150927 Oct 19 22:21:41.876033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1333/2680] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:42.408890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:42.409453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:42.416945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.417431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.417899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.418592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.419069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.419498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.437443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:42.438096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:42.444870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.445368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.445810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.446514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.447078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.447609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.554360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:42.563500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3f2c2b29-6214-4695-831c-2de4b428baf4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.158437 Oct 19 22:21:42.571516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1348/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:42 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:42.578914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:42.579832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:42.587304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.587787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.588220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.588974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.589401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.589820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.597663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:42.607923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2456daf0-2354-4969-8d9f-5eba5682b98d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.175107 Oct 19 22:21:42.608500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1334/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:42.613160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:42.614214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:42.620200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.620684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.621120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.621910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.622381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.622869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.658179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:42.666804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-28597300-55fd-47cc-a032-5bdefe19c6f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.093939 Oct 19 22:21:42.667422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1349/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:42.751177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:42.759689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b1f6deee-97bf-4052-a521-f73d6715cd5f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150191 Oct 19 22:21:42.760256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1335/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:42.901886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:42.902522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:42.908417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.908898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.909334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:42.910012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:42.910482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:42.910932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.035646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:43.044117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:43.045557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:43.046713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-94fae6f9-dd15-48e6-b151-14f5fd3a4222 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.148718 Oct 19 22:21:43.047323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1350/2685] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:43.587487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:43.588094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:43.594533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.595041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.595472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.596151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.596621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.597016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.631419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:43.632026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:43.638551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.639054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.639492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.640180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.640627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.641044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.723725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:43.731999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4fddc19e-a4d5-46f4-b1a3-0f0d2164a77f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149153 Oct 19 22:21:43.732945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1336/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:43 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:43.737223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:43.737896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:43.744147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.744701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.745217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.746128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.746941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.747244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.774557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:43.785415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-70d82294-98ad-4b4b-930a-c758e784a654 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.158206 Oct 19 22:21:43.791074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1351/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:43.791074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:43.791797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:43.797773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.798582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.799020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.799830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:43.800408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:43.800936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:43.821243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:43.829571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bcb53874-1470-42c4-8cb2-f26ba1fd09bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.095985 Oct 19 22:21:43.830152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1337/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:43.930446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:43.938562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3d3650e5-26d9-410e-9af7-cb52ed47f285 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151366 Oct 19 22:21:43.939164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1352/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:44.073568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:44.074115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:44.080061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.080539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.081032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.081729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.082278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.082734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.212030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:44.220615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:44.222055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:44.223750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9af6ac15-f4da-471b-b50a-cce39148a77d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153625 Oct 19 22:21:44.224319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1338/2690] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:44.754890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:44.755559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:44.762132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.762616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.763085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.763772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.764224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.764649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.808503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:44.809256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:44.815735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.816219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.816651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.817851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.818563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.819008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.906062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:44.914419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3c70ccff-fd5c-40fc-8de2-4edac2064338 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.163360 Oct 19 22:21:44.915117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1353/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:44 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:44.919863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:44.920534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:44.926177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.929673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.929673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.929673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.929673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.931592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.956174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:44.965011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9a4b9bda-8141-486f-ad0a-30ac976ea82c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.160276 Oct 19 22:21:44.965591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1339/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:44.970177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:44.970776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:44.976584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.977065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.977493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.978171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:44.978614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:44.979072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:44.993426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:45.001246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9638e1a3-130c-4e93-a37f-5d88ee6bcc0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085117 Oct 19 22:21:45.001817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1354/2693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:45.105829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:45.113982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3823eec5-dee5-4ee5-997b-4db347bc38f0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147470 Oct 19 22:21:45.114546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1340/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:45.249580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:45.250194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:45.256735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:45.257221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:45.257669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:45.258357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:45.258816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:45.259307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:45.385311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:45.393889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:45.395375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:45.396537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f7afd2a3-3fa3-48f8-a9bb-c220f90be0cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150904 Oct 19 22:21:45.397097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1355/2695] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:45.937188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:45.937802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:45.945223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:45.945704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:45.946140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:45.946827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:45.947309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:45.947882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:45.989835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:45.990482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:45.996926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:45.997413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:45.997854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:45.998549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:45.999027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:45.999455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:46.077372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:46.085712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9078fdb6-be99-4759-98ff-a2b75453c06a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152294 Oct 19 22:21:46.086277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1341/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:45 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:46.090838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:46.091489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:46.097933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:46.098433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:46.098873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:46.099601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:46.100063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:46.100491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:46.127046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:46.136493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-56031dcd-76ca-48df-8fc9-55068bca843a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151019 Oct 19 22:21:46.137077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1356/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:46.141508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:46.142115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:46.148232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:46.148707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:46.149147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:46.153149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:46.153149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:46.153149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:46.165919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:46.174390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c5b1f4bb-b79d-403f-92e8-744c36344bc4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087149 Oct 19 22:21:46.174980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1342/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:46.282030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:46.290201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-630784f0-20d3-4c6d-b45b-48c1a634a282 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152186 Oct 19 22:21:46.290772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1357/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:46.421355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:46.421899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:46.428743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:46.429224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:46.429661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:46.430339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:46.430789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:46.431247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:46.557342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:46.559496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:46.566410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:46.567923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:46.569375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bff0bf33-ac61-4c4e-963e-6ed2ce419b65 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151979 Oct 19 22:21:46.569937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1343/2700] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:47.109032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:47.109570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:47.116188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.116671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.117110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.117796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.118252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.118676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.159733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:47.160329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:47.167461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.167941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.168371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.169056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.169503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.169919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.246124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:47.255018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b2e2fdc3-9ebd-49dc-a686-8e1492b0874f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149462 Oct 19 22:21:47.255597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1358/2701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:47 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:47.260072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:47.260681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:47.266384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.267502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.268095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.268799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.269258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.269731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.297699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:47.313409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-de4643bb-b0c8-48f0-b1e6-cc2f7aa8e03a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.157467 Oct 19 22:21:47.313993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1344/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:47.319392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:47.320002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:47.325925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.326414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.326851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.327698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.328161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.328586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.341482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:47.350941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-25758782-5729-438b-b283-9d5dd734b7db tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.094362 Oct 19 22:21:47.351547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1359/2703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:47.461244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:47.469342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e8d31508-c4e4-4ce7-ba7d-70de563ea15d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154428 Oct 19 22:21:47.473673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1345/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:47.593506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:47.594111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:47.599964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.600436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.600866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.601537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:47.601983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:47.602403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:47.606206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:47.731361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:47.740453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:47.742509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:47.743062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-769cf437-c50d-497f-acc0-3e85e3924c71 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153384 Oct 19 22:21:47.743624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1360/2705] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:48.279082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:48.279638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:48.286491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.286974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.287418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.288091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.288536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.288953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.338146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:48.338871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:48.345647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.346127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.346559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.347327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.347781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.348844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.418926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:48.427653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-128387ed-ed4f-490f-b308-c724860645a3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152503 Oct 19 22:21:48.428251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1346/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:48 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:48.432719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:48.433331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:48.439395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.439797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.440505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.440932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.441391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.441907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.480898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:48.489355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a626fa02-8eb3-4e9c-83d9-da2494b655f8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.155035 Oct 19 22:21:48.489943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1361/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:48.494454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:48.495095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:48.500960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.501447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.501885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.502579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.503058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.503494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.507710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:48.516103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-908a4560-142e-4aa6-aeb8-efe6f9f010b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086904 Oct 19 22:21:48.516707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1347/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:48.637283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:48.646051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e979cfaf-6a56-4b6c-99de-f929a03d16ef tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155178 Oct 19 22:21:48.646612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1362/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:48.768942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:48.769552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:48.776458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.776927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.777365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.778050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:48.778504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:48.778929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:48.920212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:48.928729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:48.930158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:48.931364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-638a60de-339a-4f10-8988-25694c12fe36 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.166243 Oct 19 22:21:48.931921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1348/2710] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:49.450025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:49.450668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:49.456867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.457351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.457782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.458464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.458916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.459356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.512700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:49.513296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:49.519624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.520146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.520576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.521261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.521705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.522122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.585220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:49.593270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3375cf6-a43e-49c1-aa8e-bab79fff6727 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147185 Oct 19 22:21:49.593846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1363/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:49 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:49.598733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:49.599597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:49.605079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.605778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.606388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.607274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.607900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.608325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.651444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:49.659598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b0533a5a-b4a7-4c75-ad78-255244ff3ce1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150805 Oct 19 22:21:49.660166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1349/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:49.668717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:49.669434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:49.669908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:49.675433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.676784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.677404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.678155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.678617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.679076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.679190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8fefb661-193a-424f-a83a-af2fb5061fb5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084309 Oct 19 22:21:49.679703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1364/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:49.809695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:49.817723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d10b7ece-9956-40b5-8462-54c4bb63875c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152736 Oct 19 22:21:49.818548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1350/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:49.957915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:49.958560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:49.964463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.964938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.965367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:49.966040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:49.966485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:49.966902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.095698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:50.104845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:50.106325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:50.107568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-51099ca7-36b8-4000-aef8-c7bc333c25fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154097 Oct 19 22:21:50.108132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1365/2715] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:50.617022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:50.617637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:50.623680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.624191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.624626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.625305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.625756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.626178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.683733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:50.684319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:50.690750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.691264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.691699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.693052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.693762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.694192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.756140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:50.764447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed7ab02a-ba5a-4dfc-a099-30f1fc2fe6f8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151933 Oct 19 22:21:50.765336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1351/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:50 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:50.769774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:50.770384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:50.776171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.776659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.777099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.777788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.778246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.778671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.826312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:50.834472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-12a06aa3-4935-4581-87c5-162614ae377e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154597 Oct 19 22:21:50.836369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1366/2717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:50.848642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:50.849376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:50.855263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.855749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.856186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.856310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:50.856874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:50.857324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:50.857743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:50.865148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2e43b88-df05-47f1-8521-22072c634aa7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.098833 Oct 19 22:21:50.867121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1352/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:50.987872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:50.996591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cc4a5631-7f93-40f4-9536-fd9eead61533 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152216 Oct 19 22:21:50.997156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1367/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:51.132727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:51.133262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:51.139176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.139655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.140088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.140763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.141212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.141629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.270967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:51.279535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:51.280958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:51.282104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-788a5127-e6da-4794-b9e1-310907c34a68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153360 Oct 19 22:21:51.282661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1353/2720] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:51.788142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:51.788610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:51.795193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.795673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.796101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.796781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.797225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.797640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.858364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:51.858987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:51.865268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.865742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.866177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.866852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.867324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.867746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.925648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:51.933775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-51b12af1-64a6-4b0f-9884-c5b5d1b9e0e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149740 Oct 19 22:21:51.934344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1368/2721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:51 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:51.938656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:51.939350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:51.945644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.946128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.946562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.947320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:51.947770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:51.948193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:51.997738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:52.006430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6ed91681-d7af-4118-b037-4e489adf384e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151858 Oct 19 22:21:52.007249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1354/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:52.009991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:52.018159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6b2ee3f9-74b4-4518-9f9e-da4ae3d66551 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082882 Oct 19 22:21:52.019006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1369/2723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:52.019507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:52.020217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:52.026186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:52.026672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:52.027140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:52.027843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:52.028279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:52.028699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:52.159197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:52.167419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9fd610c5-f5ef-4541-90ad-992ed955e4d0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151749 Oct 19 22:21:52.167975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1355/2724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:52.308295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:52.308898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:52.315316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:52.315792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:52.316225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:52.317550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:52.317998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:52.318672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:52.657496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:52.666520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:52.668005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:52.669152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9b9657a2-f142-4953-ad0a-c4841bedc0b2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.364764 Oct 19 22:21:52.669695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1370/2725] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:52.958489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:52.959163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:52.965623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:52.966096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:52.966524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:52.967223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:52.967670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:52.968085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.030078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:53.030697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:53.037834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.038307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.038749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.039477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.039929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.040357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.097449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:53.105818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9e44f6ef-b61b-4521-8e07-484a2425993d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151687 Oct 19 22:21:53.106385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1356/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:52 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:53.110832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:53.111709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:53.117500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.117985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.118419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.119129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.119987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.120492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.171146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:53.179656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a14bf3e2-4ad6-4783-9134-6f4dc3f6898a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153373 Oct 19 22:21:53.180234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1371/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:53.181545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:53.190211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d528923a-e121-4517-874c-43b0f48a6001 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082816 Oct 19 22:21:53.190778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1357/2728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:53.191143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:53.192340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:53.198498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.199088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.199611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.200369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.200897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.201425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.328443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:53.337214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e9b49ede-2de6-4d35-8dc4-3687dbd52376 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150258 Oct 19 22:21:53.337778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1372/2729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:53.695717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:53.696319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:53.702231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.702708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.703163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.703881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:53.704308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:53.704722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:53.834322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:53.843251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:53.844680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:53.845835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0018b21b-57a4-419d-af87-ddb95dd260c9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154894 Oct 19 22:21:53.846414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1358/2730] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:54.128705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:54.129828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:54.136399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.136871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.137309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.137994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.138446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.138868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.203586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:54.204228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:54.211261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.211744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.212183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.212868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.213578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.214186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.269268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:54.277624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-40b3089f-3c4b-418c-9fd3-a0955732f921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152785 Oct 19 22:21:54.278493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1373/2731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:54 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:54.290089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:54.290694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:54.298163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.298637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.299112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.299811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.300271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.300700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.343944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:54.352310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b1148580-614a-4d37-aa17-a51020c28ed9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152731 Oct 19 22:21:54.352896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1359/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:54.359876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:54.360543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:54.361895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:54.367057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.367549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.367985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.368864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.369324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.369752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.370689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5d6e1822-a553-4a86-8351-ec6aa8fc2a96 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084651 Oct 19 22:21:54.371273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1374/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:54.384896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:54.499930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:54.508620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2aecf1a-4569-4988-aa5c-1928abb25018 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152495 Oct 19 22:21:54.509185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1360/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:54.870972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:54.871602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:54.877511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.877983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.878482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:54.879430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:54.879883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:54.880303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.016457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:55.019628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:55.021609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:55.022777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e89f3395-c3a4-444e-a98b-e3a38c731d19 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155669 Oct 19 22:21:55.023373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1375/2735] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:55.300660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:55.301280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:55.307672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.308187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.308626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.309318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.309769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.310194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.376132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:55.376805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:55.383795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.384310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.384749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.385667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.386304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.386541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.437402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:55.446517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-47838fdf-46d6-469d-b731-87c601659aed tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149775 Oct 19 22:21:55.447107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1361/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:55 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:55.451724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:55.452323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:55.458440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.458915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.459376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.460054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.460504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.460922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.522253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:55.522638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:55.524846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:21:55.531779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4d1f588b-e720-4f29-8b0e-2c62439de12b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083700 Oct 19 22:21:55.531974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ae9ac52b-2f74-4714-adf5-6a0718bdaa79 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.159557 Oct 19 22:21:55.532350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1362/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:55.532747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1376/2738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:55.536964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:55.537569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:55.543523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.544073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.544577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.545378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:55.545884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:55.546389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:55.676209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:55.684376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dff3a7b9-c355-408b-b898-821b47d41661 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151095 Oct 19 22:21:55.684939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1363/2739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:56.048699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:56.049305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:56.056357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.056828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.057255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.057928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.058373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.058789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.187348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:56.196134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:56.197579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:56.198740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-58bc13c3-d56b-439b-a881-eaa3acd96ed5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153956 Oct 19 22:21:56.199332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1377/2740] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:56.469919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:56.470526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:56.477528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.478002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.478427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.479127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.479575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.479989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.553960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:56.554983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:56.561091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.561583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.562028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.562720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.563212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.563641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.609841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:56.614947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1db93cab-c2ab-40ce-a889-53d13adb5edf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148921 Oct 19 22:21:56.615537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1364/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:56 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:56.619906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:56.620506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:56.625782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:56.626666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.627313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.627746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.628429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.628876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.629418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.637680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-afa6f690-8673-445a-b070-2732dab2630e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087721 Oct 19 22:21:56.638339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1378/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:56.707992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:56.709108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:56.715078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.715561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.716036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.716723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:56.717170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:56.717587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:56.756171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:56.764540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-99c5fa76-cefe-405b-a41d-a1a9a0b2987c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148040 Oct 19 22:21:56.765210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1365/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:56.848163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:56.856306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-569cd3e4-2990-4aab-9f57-44b8251cb977 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152087 Oct 19 22:21:56.856882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1379/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:57.224679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:57.225314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:57.231267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.231746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.232182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.232860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.233310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.233734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.363013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:57.373006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:57.373006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:57.374061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0f5fb690-20c0-41c7-9cf1-2c512e3e23ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153996 Oct 19 22:21:57.374627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1366/2745] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:57.638300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:57.638846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:57.645244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.646345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.646789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.647501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.647959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.648397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.660489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:57.661096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:57.667547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.668027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.668460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.669136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.669581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.669996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.732215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:57.740799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-48fe64cc-c1ee-457c-8ca6-538ddec0b804 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084042 Oct 19 22:21:57.741379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1367/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:57.780770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:57.788410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:57.797975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:57.798764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ea489864-98d5-4af8-a3da-7547acbd5057 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155213 Oct 19 22:21:57.798764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1380/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:57 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:57.799020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.799020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.799020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.799020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.799448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.799448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.879385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:57.880033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:57.886664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.887191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.887633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.893644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:57.893644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:57.893644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:57.933113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:57.941289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e7e6cc06-9699-4e91-94c5-f33edf7cde04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.156810 Oct 19 22:21:57.941991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1368/2748] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:58.017019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:58.025272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5faee60f-e151-4f51-8f6f-b4d743eb8328 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149762 Oct 19 22:21:58.025843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1381/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:58.399713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:58.400327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:58.406344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.406829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.407300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:58.407983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.408436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.408861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:58.535315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:58.544248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:58.545703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:58.546891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3f70d939-e8ba-4aed-ab9c-b9074aa18fe7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151715 Oct 19 22:21:58.547516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1369/2750] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:58.764031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:58.764646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:58.771023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.771505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.771940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:58.772617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.773072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.773492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:58.813485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:58.814241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:58.821706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.822188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.822625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:58.823367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.823822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.824245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:58.834594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:58.847548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b54c8792-dcc5-4a35-8990-f7726b6ffdbf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087297 Oct 19 22:21:58.848130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1382/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:58.962098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:58.965522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:58.966127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:58.972158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.972638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.973068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:58.973597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8f6d3623-b258-4d5f-8947-9f21ba427978 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.163921 Oct 19 22:21:58.973975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:58.974236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1370/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:58 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:58.974427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:58.974846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:59.049439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:59.055489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:59.056697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:59.057179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:59.057612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:59.058294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:59.058841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:59.059286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:59.106767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:59.116671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-deab2105-e708-4dfb-9c2c-8a8404580876 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154866 Oct 19 22:21:59.117253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1383/2753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:59.190904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:59.199324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-47108651-b26c-4a3e-bde6-b7d00d941229 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154026 Oct 19 22:21:59.199953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1371/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:21:59.572930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:59.573531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:59.579441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:59.579918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:59.580347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:59.581028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:59.581477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:59.581891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:59.705616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:59.714545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:59.716033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:59.717226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d1edbd47-227f-4462-917c-54f207d8c294 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.148192 Oct 19 22:21:59.717784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1384/2755] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:21:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:21:59.870105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:59.870658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:21:59.877131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:59.877614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:59.878052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:59.878734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:21:59.879211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:21:59.879638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:21:59.939731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:21:59.948643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-618b4199-6eff-4cad-bd41-ee3f2ae8eed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082462 Oct 19 22:21:59.949208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1372/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:21:59.996459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:21:59.997064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:00.003570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.004042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.004473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.005653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.006126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.006543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.136777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:00.139999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:00.140693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:00.144968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03270e9a-1ecb-45d7-a5b2-513aa9d42f54 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152361 Oct 19 22:22:00.145546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1385/2757] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:21:59 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:00.147176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.147660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.148098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.148790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.149240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.149663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.221897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:00.222506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:00.228817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.229293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.229725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.230404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.230852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.231301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.277909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:00.286131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d81f63e7-ce07-4bcf-ba31-3a29f49386ca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150087 Oct 19 22:22:00.287077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1373/2758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:00.357234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:00.365780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-318c6a4d-338e-4eb2-841c-43c78644a260 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147726 Oct 19 22:22:00.366346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1386/2759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:00.742844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:00.743474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:00.749325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.749800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.750233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.750906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.751378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.751792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.880863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:00.889247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:00.890674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:00.891878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b77b7b7b-8538-48ab-bdd7-6f765504b046 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153568 Oct 19 22:22:00.892425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1374/2760] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:00.971899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:00.972497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:00.975014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:00.979630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.980110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.980543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:00.981224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:00.981681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:00.982095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.043755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:01.052329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fbd2430c-66e4-44c6-b5d1-2a98d2e70490 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084161 Oct 19 22:22:01.052932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1387/2761] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:01.168615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:01.169237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:01.175183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.175665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.176101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.176787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.177244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.177671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.303245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:01.309226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:01.309847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:01.311542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4b791311-52ad-4e45-8742-8b7c96bb5800 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146887 Oct 19 22:22:01.312131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1375/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:01 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:01.315699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.316179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.316618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.317334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.318289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.318984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.389230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:01.389842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:01.391704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:01.397415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.397804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.398236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.398923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.399401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.405412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.450771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:01.459948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9fca9865-2bcb-4216-91e0-cbbbc7fefebc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154499 Oct 19 22:22:01.460795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1388/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:01.529870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:01.537959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dcc8d898-37fc-47ce-8976-b4ed54fe8359 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152703 Oct 19 22:22:01.538513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1376/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:01.917237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:01.917840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:01.923817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.924293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.924721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:01.925402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:01.925844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:01.926259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.051418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:02.060354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:02.061769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:02.062914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d4fe6dd8-b183-4724-9938-0dbc90e85a39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149534 Oct 19 22:22:02.063491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1389/2765] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:02.075112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:02.075729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:02.082266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.082785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.083328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.084014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.084494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.084918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.087439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:02.147674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:02.156571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d244c2fd-6d75-4743-ba88-3ca2450cbe57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085325 Oct 19 22:22:02.157148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1377/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:02.335354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:02.335911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:02.341825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.342303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.342735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.343437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.343891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.344311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.469956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:02.478757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a9aeb359-2b2b-4976-b4bd-eed49e95050d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147363 Oct 19 22:22:02.479343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1390/2767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:02 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:02.483590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:02.484212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:02.490268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.490755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.491226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.491920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.492381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.492808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.561146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:02.561771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:02.567843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.568329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.569036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.569760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:02.570217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:02.570641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:02.621228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:02.629716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-785d0ba5-6bcf-4c16-98c9-3f7b92548828 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149956 Oct 19 22:22:02.630421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1378/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:02.698848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:02.707069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a5f45d37-9efc-4f41-b4c6-b5b31f7e083f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149801 Oct 19 22:22:02.707639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1391/2769] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:03.090353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:03.090989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:03.097388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.097863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.098303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.098971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.099426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.099842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.184269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:03.184905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:03.191605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.192089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.193131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.194107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.194556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.194989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.231023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:03.240252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:03.241681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:03.242850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e5f791a7-a298-4d22-bd6f-819772b5872b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156444 Oct 19 22:22:03.243440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1379/2770] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:03.254866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:03.263685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3705303-de69-4cca-830b-1dfa0efbd97c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083241 Oct 19 22:22:03.264245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1392/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:03.501457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:03.502068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:03.508692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.509173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.509606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.510288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.510735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.511186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.635985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:03.643940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b7005e16-a743-480b-a537-23c9c0d1b3f4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146313 Oct 19 22:22:03.644500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1380/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:03 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:03.652848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:03.653461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:03.659675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.660155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.660587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.661775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.662227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.662646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.676975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:03.730159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:03.730919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:03.736763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.737246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.737683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.738403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:03.738854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:03.740014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:03.797321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:03.806106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9d16642a-65cb-4a83-940e-288c0e9590ed tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.157037 Oct 19 22:22:03.806677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1393/2773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:03.870444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:03.878794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-284c9a53-5cbd-4321-bc30-fcfd380c42e1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152477 Oct 19 22:22:03.879379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1381/2774] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:04.269029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:04.269632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:04.276575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.277061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.277500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.278189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.278645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.279098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.285405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:04.286088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:04.293034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.293492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.293952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.294606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.295079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.304313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.358323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:04.366652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6c4bdd05-4faf-428a-b53b-b60e6a9caffa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084943 Oct 19 22:22:04.367253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1382/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:04.408186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:04.416782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:04.418224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:04.419413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4a35547a-b2fc-4020-9b21-fa822f4ffc41 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154332 Oct 19 22:22:04.419969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1394/2776] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:22:04.666530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:04.667096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:04.672973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.673448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.673880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.674551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.675022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.675442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.801044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:04.809662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-58c8f452-6b67-453d-96c4-0dad7353de71 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147052 Oct 19 22:22:04.810226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1383/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:04 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:04.829463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:04.830080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:04.836068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.836553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.836994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.837681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.838137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.838560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.901550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:04.902397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:04.908499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.909061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.909518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.910209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:04.910667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:04.911163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:04.977349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:04.985636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-452e75f2-b962-4ca4-9e71-74d7dccc7178 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.159941 Oct 19 22:22:04.986298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1395/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:05.051099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:05.059583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-967282b7-250e-4cc7-8398-c5581c706628 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.161885 Oct 19 22:22:05.060139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1384/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:05.389595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:05.390203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:05.396642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:05.397124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:05.397560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:05.398243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:05.398716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:05.399158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:05.444719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:05.445438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:05.451793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:05.452344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:05.452842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:05.453591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:05.454106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:05.454591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:05.464983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:05.473187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8774af48-056c-4782-a93f-fd0cd35c16b4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087450 Oct 19 22:22:05.473815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1396/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:05.580837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:05.589933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:05.591382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:05.592533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c0b7610f-4f1d-4579-a8f3-626950384b43 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152035 Oct 19 22:22:05.593087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1385/2781] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:22:05.834184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:05.834796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:05.840777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:05.841268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:05.841703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:05.842389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:05.842851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:05.843287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:05.968736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:05.976842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c28c7231-6116-4076-b6a5-64d44f2a3110 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147129 Oct 19 22:22:05.977413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1397/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:05 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:06.010000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:06.010639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:06.016495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.016970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.017399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.018195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.018649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.019096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.083834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:06.084501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:06.090424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.090915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.091412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.092098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.092549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.092969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.150221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:06.158394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a17dc10-91ad-4e39-a8ed-59c1d8675a95 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152199 Oct 19 22:22:06.158978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1386/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:06.219491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:06.227748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bb3ed57c-2417-493d-b0d9-3596dc1fede7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148511 Oct 19 22:22:06.228311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1398/2784] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:06.496630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:06.497244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:06.503662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.504144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.504578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.505265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.505718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.506140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.566395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:06.575222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-36f1badb-a3b9-4964-af5a-b8e6b5e72e77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082455 Oct 19 22:22:06.575783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1387/2785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:06.617927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:06.618532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:06.624985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.625463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.625896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.626570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:06.627047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:06.627467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:06.756058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:06.764465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:06.765918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:06.767096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f3b3fec-2f45-4284-a5d1-dcf146c034f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153021 Oct 19 22:22:06.767651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1399/2786] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:06.999373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:06.999985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:07.005953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.006375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.006810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.007525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.007978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.008401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.134113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:07.142200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2e85e03c-462a-4725-91c2-8258e2bc44aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146669 Oct 19 22:22:07.142760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1388/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:06 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:07.181644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:07.182248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:07.188101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.188576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.189007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.189681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.190133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.190546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.251096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:07.251765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:07.257674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.258096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.258530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.259278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.259742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.260166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.318090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:07.326589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d21824c8-301d-4509-8618-807a24498874 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148804 Oct 19 22:22:07.327179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1400/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:07.389729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:07.398560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-496def89-c5d7-489c-b314-e61a51e08528 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151359 Oct 19 22:22:07.399201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1389/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:07.598196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:07.598856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:07.604740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.605222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.605658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.606337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.606790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.607240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.667273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:07.675303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2c7e2fb3-4496-45ff-a9b8-21b24579aad6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.080905 Oct 19 22:22:07.675862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1401/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:07.793120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:07.796432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:07.799893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.800376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.800813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.801504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:07.801957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:07.802383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:07.929950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:07.938600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:07.940056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:07.941218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-06482776-ed4d-4d7e-9c62-85bcae59f583 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152030 Oct 19 22:22:07.941809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1390/2791] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:08.165849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:08.166516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:08.172763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.173252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.173679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.174351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.174799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.175251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.304664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:08.312701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-214dfafe-fc5f-47b0-b9ff-dbddf4e1f670 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151364 Oct 19 22:22:08.313271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1402/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:08 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:08.351090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:08.351699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:08.357618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.358088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.358517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.359220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.359666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.360080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.421709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:08.422215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:08.428808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.429294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.429730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.430462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.430921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.431376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.490160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:08.498365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74f511d3-96a9-4cc3-9e79-37664826933a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151583 Oct 19 22:22:08.498935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1391/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:08.561337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:08.569704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-527c2b56-2dd5-4b7b-80ef-d05a4d6441c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151909 Oct 19 22:22:08.570265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1403/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:08.697678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:08.698288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:08.704234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.704718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.705161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.705846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.706297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.706720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.769327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:08.777928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91d1620a-50a4-4828-8260-23d277d8edb9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084297 Oct 19 22:22:08.778486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1392/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:08.967936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:08.968480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:08.974918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.975428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.975865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:08.976547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:08.977001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:08.977422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.110642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:09.119266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:09.120777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:09.121937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-885aa01d-56f8-400e-9caa-636b95c7840b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157931 Oct 19 22:22:09.122487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1404/2796] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:09.334910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:09.335494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:09.341851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.342333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.342768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.343484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.343937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.344360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.469619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:09.471818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:09.478308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a57f433c-54e7-4638-aa0f-16f131f917d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147315 Oct 19 22:22:09.478876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1393/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:09 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:09.521122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:09.521736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:09.527731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.528217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.528659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.529346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.529800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.530225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.592329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:09.592869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:09.599707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.600221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.600655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.601428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.601882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.602306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.659360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:09.668173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-db9f0dbe-9f98-4dc7-b4a6-47bf8fe51f26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150914 Oct 19 22:22:09.668740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1405/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:09.731161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:09.739442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ac0834bb-8fd9-49a5-82ff-6656d6372c91 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150994 Oct 19 22:22:09.740591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1394/2799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:09.800869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:09.801498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:09.808099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.808573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.809006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.809676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:09.810120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:09.810535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:09.870122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:09.878340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2b57ef03-c1a1-4cdc-b189-8b1a01ca7500 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081234 Oct 19 22:22:09.878905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1406/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:10.148090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:10.148620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:10.154734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.155241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.155675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.156445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.156890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.157306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.282607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:10.291680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:10.293102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:10.294250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-229c9028-a660-420f-8d68-1fe05ac4623f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150721 Oct 19 22:22:10.294807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1395/2801] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:10.501596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:10.502208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:10.509180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.509666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.510105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.510790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.511277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.511708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.641571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:10.650210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5ff3e3b6-3629-4caf-9c01-3ceedba4f92e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152466 Oct 19 22:22:10.650776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1407/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:10 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:10.691846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:10.692474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:10.699943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.700419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.700845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.701525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.701968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.702384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.762351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:10.763039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:10.768959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.769520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.769962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.770649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.771133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.771560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.830033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:10.838578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-17fafc91-8b4f-4ccc-9e0b-4a9ff2cf4f41 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150547 Oct 19 22:22:10.839174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1396/2803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:10.898114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:10.900698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:10.901309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:10.906409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-983355d6-0b5d-4d52-a3b1-9561d03da5ce tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147954 Oct 19 22:22:10.906995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1408/2804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:10.907135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.907544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.907977 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.908655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:10.909100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:10.909519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:10.975139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:10.983209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d41a2708-b9ac-415e-b34b-dc6b64fec827 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086234 Oct 19 22:22:10.983763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1397/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:11.319667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:11.320274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:11.326272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.326750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.327217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.327901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.328382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.328802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.458943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:11.467531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:11.468975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:11.470134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-16b46424-2162-4db9-b908-51309812e517 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154703 Oct 19 22:22:11.470698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1409/2806] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:11.673003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:11.673553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:11.679513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.680022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.680457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.681139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.681594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.682020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.808431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:11.816583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cc005602-a548-441c-98ca-ba9804f052ca tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147443 Oct 19 22:22:11.817148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1398/2807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:11 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:11.861383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:11.862028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:11.868414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.868900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.869337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.870025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.870481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.870966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.874821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:11.929645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:11.930173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:11.936130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.936611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.937048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.937737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:11.938192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:11.938620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:11.998877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:12.007760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5d5bf628-5298-4275-9b35-5ca63d268762 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150106 Oct 19 22:22:12.008347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1410/2808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:12.013023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:12.013634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:12.019552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:12.020049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:12.020493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:12.021756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:12.022220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:12.022657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:12.067321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:12.076424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-89b8325b-2384-4881-82ed-91c575bd4f44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150696 Oct 19 22:22:12.076995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1399/2809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:12.084105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:12.092479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-32768593-d27a-444f-b421-6de16f8c38f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082962 Oct 19 22:22:12.093066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1411/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:12.496346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:12.496957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:12.502927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:12.503429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:12.503871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:12.504555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:12.505035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:12.505460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:12.633213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:12.641727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:12.643205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:12.644367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9f1a8b0c-ede4-4f0c-bca5-780aaf40885a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152034 Oct 19 22:22:12.644931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1400/2811] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:12.839997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:12.840604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:12.846601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:12.847119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:12.847562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:12.848238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:12.848692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:12.849111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:12.978522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:12.986583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9e4da22a-d1a6-402b-8ce4-be09f41e7c82 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150441 Oct 19 22:22:12.987176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1412/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:12 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:13.031741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:13.032355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:13.039425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.039853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.040288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.040968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.041420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.041842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.100723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:13.101324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:13.107192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.107670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.108100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.108778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.109228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.109970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.168998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:13.177535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5245bc0a-fc74-4cb0-b54d-141703c75506 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149912 Oct 19 22:22:13.178093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1401/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:13.182576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:13.183204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:13.189202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.189682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.190110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.190788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.191260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.191680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.238417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:13.246795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3d0c73df-707c-42ae-8291-3e1b77142c84 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150533 Oct 19 22:22:13.247405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1413/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:13.255648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:13.263970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-634dfe6a-f4f5-4e67-afa6-9834df58ca43 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084934 Oct 19 22:22:13.264534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1402/2815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:13.669235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:13.669843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:13.675822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.676305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.676740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.677989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:13.678466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:13.678887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:13.810939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:13.819735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:13.821159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:13.822305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-30618706-b861-439a-a2ae-c671b1770ed2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156943 Oct 19 22:22:13.822856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1414/2816] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:14.008531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:14.009140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:14.015146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.015629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.016061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.016740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.017193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.017616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.147623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:14.155696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d3af869b-aaed-4ab0-b669-d141dc69e199 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151031 Oct 19 22:22:14.156247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1403/2817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:14 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:14.200559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:14.201166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:14.207509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.207964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.208420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.209101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.209549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.209968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.270359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:14.271674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:14.277584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.278142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.278647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.279440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.279961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.280455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.340191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:14.348528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7f5f952f-e936-42a0-abc1-ceb145f9504c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151891 Oct 19 22:22:14.349096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1415/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:14.353472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:14.354092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:14.359625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.360107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.360538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.361251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.361700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.362140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.414394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:14.422996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fd1a6b54-e25f-4809-a8f4-0deb38b1254c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.156508 Oct 19 22:22:14.423777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1404/2819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:14.423934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:14.432317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f33b1a49-86f2-4f87-b1ee-890030ae6aa3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082251 Oct 19 22:22:14.432961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1416/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:14.848121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:14.848725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:14.855160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.855634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.856341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.857340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:14.857794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:14.858212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:14.987965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:14.997101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:14.998527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:14.999711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0d8d37c8-1ba5-4bc2-8081-fbc668dd3057 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155576 Oct 19 22:22:15.000263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1405/2821] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:15.178232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:15.178757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:15.184678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.185300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.185735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.186413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.186861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.187390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.320086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:15.328361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-59efe809-b2a4-4453-839f-a6bdc751d8fe tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154667 Oct 19 22:22:15.328926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1417/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:15 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:15.372330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:15.372944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:15.379309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.379787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.380225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.380934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.381639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.382067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.446851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:15.447494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:15.453532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.454020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.454455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.455175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.455629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.456058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.509890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:15.518224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cc7d2f6e-7701-4e03-845d-72a7bbc9408f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149666 Oct 19 22:22:15.518796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1406/2823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:15.523798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:15.524529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:15.530128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.530628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.531085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.531770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:15.532223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:15.532645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:15.589858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:15.595080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:15.603659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-081c6c58-f819-4f68-82b3-09fe7f36e521 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083860 Oct 19 22:22:15.604695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1407/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:15.607498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-02e63e78-99a3-4590-a033-b0ea93e32cf6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.164337 Oct 19 22:22:15.607971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1418/2825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:16.025033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:16.025667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:16.031976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.032450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.032885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.033556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.034003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.034422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.165742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:16.174172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:16.175636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:16.176791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf47654a-32f8-4a38-bf81-8eeedb0da1b9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155657 Oct 19 22:22:16.177351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1408/2826] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:16.351480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:16.352094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:16.358715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.359183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.359624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.360312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.360792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.361201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.486539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:16.494752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-661c692a-f17f-4614-b6dd-e4a5719305af tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147127 Oct 19 22:22:16.495344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1419/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:16 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:16.541345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:16.541954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:16.548398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.548879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.549313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.549996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.550448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.550869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.626466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:16.627226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:16.633922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.634483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.635017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.635831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.636356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.636846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.678007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:16.686244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c3e2ca6c-c0d8-49a0-8284-a29a8785d350 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148612 Oct 19 22:22:16.686818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1409/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:16.691530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:16.692132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:16.698533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.699067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.699506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.700259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:16.700737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:16.701159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:16.702314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:16.710601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-22a1d811-c963-4c3b-a9c5-fd6dec6ec509 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088040 Oct 19 22:22:16.711337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1420/2829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:16.716037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:16.830507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:16.838651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed92ee32-af8c-43e5-9a44-9cba83121794 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150884 Oct 19 22:22:16.839243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1410/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:17.201704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:17.202310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:17.208278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.208766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.209198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.209877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.210329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.210751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.337003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:17.345556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:17.347010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:17.352346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f9a18adc-f1df-46e6-99a6-5020c42b3d8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150406 Oct 19 22:22:17.352346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1421/2831] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:17.517559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:17.518098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:17.524593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.526511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.526511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.526511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.526864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.527066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.656389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:17.665160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4d316358-79ba-4334-a12a-689703d8ad21 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151595 Oct 19 22:22:17.665725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1411/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:17 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:17.709974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:17.710587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:17.717018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.717504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.717941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.718626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.719108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.719536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.733080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:17.733716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:17.739608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.740086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.740514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.741212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.741663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.742081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.807525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:17.817124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-06b7768c-32e1-49d9-b7bd-83eafc92cf47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087797 Oct 19 22:22:17.817717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1412/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:17.858813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:17.861439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:17.862042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:17.874652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0ddcfb35-1e6b-41aa-b1f5-f2953c60b8ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.162023 Oct 19 22:22:17.874804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.874935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1422/2834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:17.875096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.875096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.875096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:17.875096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:17.875504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:17.997911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:18.007594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4f4cb27e-25fb-4e12-aca8-dd5e7ee0b92b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149868 Oct 19 22:22:18.008149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1413/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:18.376645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:18.377248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:18.383248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.383732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.384164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.384902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.385351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.385775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.513226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:18.522355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:18.523823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:18.524977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d4cb214e-d3da-4b1f-9bd9-4d0cdb442121 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152242 Oct 19 22:22:18.525535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1423/2836] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:18.688341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:18.688860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:18.696043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.696522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.696959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.697636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.698087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.698510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.825058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:18.833248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3a3ec37b-6140-48d9-837e-09ed2df8603e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148785 Oct 19 22:22:18.834858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1414/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:18 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:18.840678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:18.841286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:18.847298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.847772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.848401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.849081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.849557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.849974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.891567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:18.892856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:18.900325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.900813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.901249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.901940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:18.902387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:18.902805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:18.916781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:18.925358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-22cbe484-fec5-4d90-9e84-4c6db3ff8099 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088376 Oct 19 22:22:18.935857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1424/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:19.034638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:19.035947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:19.046250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.047217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.048193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.048925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:19.049157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.049743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.050245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.057935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-46085daa-7b61-4526-b894-519c111ddfe4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.170203 Oct 19 22:22:19.058501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1415/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:19.182389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:19.190524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7c7f08f4-8185-4a04-b013-dcdec2def5b6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.163056 Oct 19 22:22:19.191121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1425/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:19.550117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:19.550725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:19.557369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.557853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.558283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.558988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.559500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.559921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.763562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:19.772621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:19.774060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:19.775260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3974bf84-d3fc-4495-b081-4dfcd057be8f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.229082 Oct 19 22:22:19.775813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1416/2841] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:19.856424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:19.857060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:19.863629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.864116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.864549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.865239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.865690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.866111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.954438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:19.955468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:19.962326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.962942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.963499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.964827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:19.965390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:19.966445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:19.997731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:19.999932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:20.006898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17a5c795-f254-471d-ac11-2a55938c452f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154418 Oct 19 22:22:20.007518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1426/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:19 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:20.045991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:20.054152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8a0f6f5-0a5c-426f-9f18-bc2e88b1f790 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.104440 Oct 19 22:22:20.054713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1417/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:20.081956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:20.082667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:20.089643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:20.090110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:20.090555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:20.091291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:20.091721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:20.092144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:20.214336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:20.214945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:20.220918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:20.221397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:20.221825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:20.222509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:20.222985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:20.223117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:20.223410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:20.231292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-96719140-cc8c-41ff-a0db-fbefc783381c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153578 Oct 19 22:22:20.231861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1427/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:20.557306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:20.565474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6aeb1c5-292e-4525-9a61-04d3fe9b65c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.355100 Oct 19 22:22:20.566038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1418/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:20.801199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:20.801814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:20.808548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:20.808976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:20.809445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:20.810132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:20.810594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:20.811050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:20.943222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:20.949512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:20.951110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:20.952257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1ee8f01a-3b46-4cc3-a50a-bdd94c0d31d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155016 Oct 19 22:22:20.952811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1428/2846] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:21.030680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:21.031315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:21.038249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.038727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.039207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.039888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.040332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.040750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.077622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:21.078147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:21.084275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.084756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.085188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.085873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.086320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.086741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.147938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:21.156562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d3bff779-177a-4790-8150-20e826f05971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082813 Oct 19 22:22:21.157226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1429/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:21.168585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:21.176634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-962baa3b-4d7c-47c3-817f-6473b61f2531 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149761 Oct 19 22:22:21.177196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1419/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:21 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:21.254101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:21.254700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:21.260599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.261074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.261506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.262177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.262623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.263063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.390057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:21.398914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3c8d4200-d159-4bfa-9220-948955628ed5 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148587 Oct 19 22:22:21.399516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1430/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:21.589828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:21.590389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:21.596371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.596840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.597269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.597970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.598417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.598834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.725280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:21.733397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-57460f72-a316-49c0-80bf-0a7d98b701c1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147427 Oct 19 22:22:21.733952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1420/2850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:21.978182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:21.978795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:21.985238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.985719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.986156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:21.986836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:21.987534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:21.987719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.113585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:22.122162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:22.123673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:22.124820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4e1a11ea-f683-452e-a51e-4badc910e3f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151103 Oct 19 22:22:22.125370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1431/2851] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:22.179485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:22.180092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:22.186391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.186872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.187336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.188021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.188474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.188903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.200270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:22.200836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:22.206649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.211218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.211218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.211218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.211218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.211618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.252971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:22.261404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f9a1eb49-0f96-47a4-b1b6-34054a52daeb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085681 Oct 19 22:22:22.261989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1421/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:22.340918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:22.349154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3cfc9721-20d3-4aae-9b12-f632568bb5ce tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152780 Oct 19 22:22:22.349714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1432/2853] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:22 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:22.422329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:22.422993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:22.428884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.429360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.429801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.430478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.430928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.431374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.555866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:22.563927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4d6499ee-87d2-4ff8-a515-fab2058b2585 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145509 Oct 19 22:22:22.564486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1422/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:22.756831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:22.757373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:22.763218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.763693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.764119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.764789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:22.765235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:22.765650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:22.893618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:22.901804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f83a080c-f38a-4062-bd8a-018581d19336 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149473 Oct 19 22:22:22.902374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1433/2855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:23.228902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:23.229546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:23.235487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.236068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.236501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.237178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.237626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.238048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.285454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:23.286061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:23.293077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.293561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.293996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.294682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.295166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.295589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.358338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:23.367685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cc237601-a68f-421f-8355-da979bef7a61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085981 Oct 19 22:22:23.368270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1434/2856] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:23.369591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:23.372696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:23.373305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:23.378529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:23.379030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.379519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.379958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.380084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:23.380684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.381139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.381255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d09fb864-fbdd-49fb-baed-f00ca9b95c79 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.235145 Oct 19 22:22:23.381565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.394974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1423/2857] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:23.506235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:23.514360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fc0de123-5c9e-414f-9be0-3cf17ba87945 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.145157 Oct 19 22:22:23.514920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1435/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:23 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:23.587967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:23.588579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:23.594437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.594916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.595377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.596059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.596507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.596933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.720522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:23.729261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a4dc95f-0cff-493b-aca4-629fd253302a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145690 Oct 19 22:22:23.729823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1424/2859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:23.929113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:23.929718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:23.935614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.936091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.936522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:23.937201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:23.937645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:23.938062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.066780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:24.075753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ad570a7b-e3b1-4295-9fb2-3054c07d25dd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150529 Oct 19 22:22:24.076309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1436/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:24.389876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:24.390456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:24.396836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.397322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.397757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.398445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.398898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.399345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.406683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:24.407307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:24.409630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:24.414446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.417746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.417746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.417746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.417746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.418159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.462813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:24.471061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4dd7a5f2-78c3-4286-9557-1d0ba6d2c931 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085165 Oct 19 22:22:24.471629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1425/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:24.537920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:24.538677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:24.540594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:24.545380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.549326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.549326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.549326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.549646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:24.549776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.549776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.557123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:24.558544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:24.559721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-603c6e47-2de3-4d3e-a4b8-7a87586a5d1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156943 Oct 19 22:22:24.560278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1437/2862] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:22:24.678485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:24.686553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b3bfed7d-60dc-44dc-9beb-31841e9d2c30 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153070 Oct 19 22:22:24.687148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1426/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:24 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:24.752342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:24.752943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:24.758845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.759358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.759791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.760468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:24.760916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:24.761334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:24.889896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:24.898017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8187f11c-cc37-4e35-9f31-ac2fc1081bfd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149397 Oct 19 22:22:24.898507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1438/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:25.099972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:25.100619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:25.106530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.107034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.107471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.108150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.108608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.109024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.112874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:25.232694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:25.241015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-695a981d-c01f-40b3-a394-15d3e8fc0fe6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145473 Oct 19 22:22:25.241582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1427/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:25.493959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:25.494565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:25.500993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.501470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.501902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.502581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.503054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.503508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.564035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:25.573009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a6084930-3deb-4973-9f85-94c8acc3b461 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083227 Oct 19 22:22:25.573561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1439/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:25.585747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:25.586358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:25.592705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.593180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.593617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.594304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.594757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.595203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.709520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:25.716281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:25.716281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.716560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.716992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.717670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.718186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.718610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.726723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:25.736320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:25.737766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:25.739064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-04581a5a-54a3-4e56-b181-ef0ccdc3be21 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157849 Oct 19 22:22:25.744937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1428/2867] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:25.856246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:25.864588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-339da2f4-7ff9-4fbf-807b-54a4b6368563 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.158922 Oct 19 22:22:25.865670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1440/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:25 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:25.920779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:25.921383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:25.927869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.928339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.928767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:25.929435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:25.929904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:25.930319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.060357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:26.069226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2c1936c-7e20-48fd-8c1f-0975bc2ad1ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152169 Oct 19 22:22:26.069761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1429/2869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:26.263959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:26.264502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:26.270286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.270766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.271232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.271916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.272366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.272786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.405514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:26.407865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-de7872f7-db54-459f-91c2-b26381d042c8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147789 Oct 19 22:22:26.408432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1441/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:26.597313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:26.597912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:26.605826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.606307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.606861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.607633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.608163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.608645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.673676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:26.682301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d321a8f0-0eb3-48a6-a5c0-fe94c6b59a44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089226 Oct 19 22:22:26.682872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1430/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:26.765384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:26.765989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:26.772845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.773318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.773748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.774422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.774864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.775309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.887815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:26.888435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:26.894275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.894758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.895501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.896765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:26.897218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:26.897639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:26.902552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:26.911100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:26.912563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:26.913715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3823a314-0b0b-42dd-ac2b-cd775296f1e2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152198 Oct 19 22:22:26.914269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1442/2872] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:27.030920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:27.039522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-95f543b8-5b1d-44e3-8489-9d702f4d9adf tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155695 Oct 19 22:22:27.040083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1431/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:26 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:27.091461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:27.092063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:27.097964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.098443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.098870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:27.100080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.100526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.100944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:27.115963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:27.230069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:27.238050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b96f0ee5-2905-4604-83c7-ee25af963eb6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150415 Oct 19 22:22:27.238613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1443/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:27.431870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:27.432427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:27.438401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.438886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.439357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:27.440050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.440504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.440932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:27.566656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:27.575554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2e3ed9f8-6881-4976-9bc7-afd479f6211c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147797 Oct 19 22:22:27.576122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1432/2875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:27.704899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:27.705500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:27.711972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.712446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.712904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:27.713577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.714026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.714443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:27.774025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:27.782043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3e3c2c3-cbed-4649-bbf3-4d4eac4d0898 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.080887 Oct 19 22:22:27.782630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1444/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:27.940022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:27.940620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:27.947946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.948424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.948859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:27.949542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:27.949997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:27.950417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.065595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:28.066204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:28.072918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.073407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.073841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.074531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.075015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.075445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.081272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:28.090987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:28.092425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:28.093582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-332ce872-92be-4039-81f0-260630d45d4c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157505 Oct 19 22:22:28.094138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1433/2877] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:28.201109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:28.209162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c7965ea3-d16b-4d9a-adda-df852e69a03c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147372 Oct 19 22:22:28.209729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1445/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:28 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:28.261736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:28.262274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:28.268118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.268593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.269020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.269691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.270133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.270548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.395351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:28.403445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dcdbbf02-0649-499c-bb94-b62432eadb53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145714 Oct 19 22:22:28.404005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1434/2879] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:28.599728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:28.600260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:28.606213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.608560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.608560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.608560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.608560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.608980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.736524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:28.744612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e9b56c92-989d-4fa2-9950-01bb9dd60b47 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149461 Oct 19 22:22:28.745197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1446/2880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:28.804545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:28.805163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:28.811168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.811647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.812080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.812757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:28.813206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:28.813627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:28.873849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:28.881911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-94d47799-adcc-4fde-91cf-9442899da971 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081213 Oct 19 22:22:28.882468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1435/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:29.117964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:29.118590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:29.125175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.125601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.126038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.126723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.127215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.127639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.232183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:29.232787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:29.239077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.239557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.239990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.240667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.241113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.241533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.254411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:29.263639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:29.265089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:29.266292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-21459415-fc89-45c7-bc9a-6c43a72bc2d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152333 Oct 19 22:22:29.266855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1447/2882] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:29.370664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:29.378889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a1b9a5ed-c8ee-4488-8376-2cd6e7c3fb52 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150453 Oct 19 22:22:29.379858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1436/2883] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:29 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:29.427703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:29.428345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:29.434212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.434698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.435180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.435921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.436377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.436801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.565645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:29.574670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9ed42d14-a0c8-475b-9401-5318dd97eaf0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151373 Oct 19 22:22:29.575272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1448/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:29.767034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:29.767653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:29.773582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.774059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.774488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.775191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.775638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.776321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.903328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:29.904456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:29.905066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:29.911997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9a669a1-a74f-43e4-94f3-9d5f061c13d9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148301 Oct 19 22:22:29.912235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.912566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1437/2885] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:29.912727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.913166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.913934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:29.914416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:29.914841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:29.976047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:29.984103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-145b93f5-10f6-46f1-8f7b-b3578de7db57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083531 Oct 19 22:22:29.984662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1449/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:30.292127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:30.292727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:30.299124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.299600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.300031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:30.300708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.301158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.301579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:30.403339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:30.404556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:30.410927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.411446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.412462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:30.413153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.413604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.414030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:30.433278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:30.441968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:30.443455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:30.446483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-27ee7aa7-3448-41b9-a6ea-1e65d8322139 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158219 Oct 19 22:22:30.447089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1438/2887] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:30.540468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:30.548748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-11955c02-8c1c-4785-86b1-256c447f4d2d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149333 Oct 19 22:22:30.549249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1450/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:30 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:30.597433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:30.598097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:30.604278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.604760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.605190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:30.605874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.606323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.606738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:30.733676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:30.741501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ce6ea46c-b579-43d2-8c8f-49c2ea203787 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147849 Oct 19 22:22:30.742067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1439/2889] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:30.935801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:30.936339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:30.942401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.943559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.944244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:30.944935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:30.945387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:30.945808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.007622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:31.008223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:31.014037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.014520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.014974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.015665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.016119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.016568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.078013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:31.081128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:31.086444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19a7834d-2b9b-4f31-b4a0-bc92f38e9c1b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083248 Oct 19 22:22:31.087242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1440/2890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:31.089559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-93b7fe79-c504-4a6e-a4bd-703aa8243d3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.157711 Oct 19 22:22:31.090200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1451/2891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:31.472095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:31.472705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:31.479821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.480312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.480752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.481444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.481902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.482330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.571667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:31.572279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:31.578628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.579147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.579587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.580277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.580724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.581146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.615718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:31.624735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:31.626216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:31.627431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4a3ee936-86cb-4c6b-8883-eb600838eba7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.159253 Oct 19 22:22:31.627999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1441/2892] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:22:31.710776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:31.718916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a684a7cd-1f96-42fe-8ae2-34405e228f06 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151370 Oct 19 22:22:31.719501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1452/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:31 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:31.765121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:31.765675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:31.772144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.772616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.773051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.773734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:31.774187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:31.774613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:31.900966 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:31.909190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a02e27da-6b32-4f0c-a1f7-291d2e05186a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148007 Oct 19 22:22:31.909760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1442/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:32.109261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:32.109804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:32.111404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:32.112021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:32.115973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.116467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.116907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.117601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.118069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.118239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.118494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.118609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.119004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.119692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.120145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.120599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.179637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:32.188160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7a540947-01d5-4806-8e89-d73658343a62 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082847 Oct 19 22:22:32.188739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1453/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:32.248106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:32.250240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:32.257461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-45656d21-ef71-46c5-afcb-549085ad4d95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149775 Oct 19 22:22:32.260617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1443/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:32.652965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:32.653558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:32.660004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.660487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.660916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.661711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.662167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.662593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.743835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:32.744432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:32.752187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.752690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.753127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.753867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.754327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.754758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.802045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:32.811471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:32.812938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:32.814091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3f3e9c4-8225-49b3-8647-5b014d3c4044 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.165032 Oct 19 22:22:32.814644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1454/2897] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:32.893044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:32.901169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ee40e783-66ce-4484-b8fd-3544c44f51be tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.162235 Oct 19 22:22:32.901735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1444/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:32 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:32.933569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:32.934141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:32.940198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.940672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.941109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:32.941770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:32.942214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:32.942630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.067793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:33.076077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-758da254-a227-4aa0-ba5a-00aa0676519d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146431 Oct 19 22:22:33.076640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1455/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:33.212074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:33.212681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:33.218676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.219191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.219623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.220331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.221156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.221276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.281162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:33.281689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:33.283444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:33.288377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.288855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.289283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.289969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.290413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.290827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.292943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b8e9e9c9-b3fa-4806-a213-167eb517db26 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085193 Oct 19 22:22:33.293511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1445/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:33.419909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:33.428006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bda50360-be87-4334-ab56-3e0e6eeef867 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150756 Oct 19 22:22:33.428573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1456/2901] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:33.840239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:33.840847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:33.847231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.847705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.848136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.848814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.849324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.849745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.924875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:33.925885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:33.932412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.932895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.933332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.934019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:33.934475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:33.934897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:33.980380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:33.988988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:33.990983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:33.992163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c1300c23-50e8-4e8f-9eab-436baf1d807d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155888 Oct 19 22:22:33.992726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1446/2902] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:34.063003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:34.071919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-eb193b31-3f68-43d2-8a9c-c8856bf9861e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150907 Oct 19 22:22:34.072484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1457/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:33 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:34.099256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:34.099868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:34.105859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:34.106380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:34.106813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:34.107557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:34.108007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:34.108467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:34.235182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:34.243959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1ad6177d-f9b1-4f10-9bc6-918719a9accd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148845 Oct 19 22:22:34.244515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1447/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:34.314878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:34.315469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:34.321828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:34.322424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:34.322860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:34.323596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:34.324043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:34.324462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:34.384398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:34.392520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3ebc11af-d296-4e43-89b7-b6254ab6b6a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081486 Oct 19 22:22:34.393393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1458/2905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:34.451111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:34.451725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:34.457569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:34.458055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:34.458491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:34.459199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:34.459658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:34.460084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:34.590837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:34.598909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b7ad9674-fe91-42b1-80a9-b425081e742d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151616 Oct 19 22:22:34.599995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1448/2906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:35.018101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:35.018700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:35.025737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.026215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.026645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.027370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.027815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.028232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.093655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:35.094371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:35.101942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.102741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.103496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.104336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.104788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.105208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.168651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:35.177622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:35.179085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:35.180225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d5b99a34-8673-43ce-a7a8-543fc4e16ab4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.166039 Oct 19 22:22:35.180973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1459/2907] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:35.255111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:35.263654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-812fd01d-cd0a-4e91-9850-8df240b6eefb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.173780 Oct 19 22:22:35.264214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1449/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:35 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:35.267772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:35.268426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:35.276993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.277470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.277900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.278589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.279065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.279485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.282323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:35.413753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:35.414636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:35.415267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:35.421115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.421624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.421957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-067a50df-7e77-471b-ba01-75275382e50c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.157979 Oct 19 22:22:35.422089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.422502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1460/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:35.422735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.423232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.423651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.485112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:35.493586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b056157-9402-4ac6-959c-2df6da1ce06e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082882 Oct 19 22:22:35.494468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1450/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:35.627029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:35.627592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:35.634156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.634635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.635093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.635800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:35.636250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:35.636666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:35.760313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:35.768421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-549f732d-691d-4ca8-a4ab-65b6af41e97f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145370 Oct 19 22:22:35.768989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1461/2911] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:36.205552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:36.206166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:36.213196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.213675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.214106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.214786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.215263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.215687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.286564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:36.287689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:36.294065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.294554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.295006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.295700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.296153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.296574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.342879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:36.352192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:36.353634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:36.354791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9e0367f1-8115-440a-9659-c69b34516110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153085 Oct 19 22:22:36.355409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1451/2912] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:36.426003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:36.434113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b572cd68-9dde-4e41-88f0-9e2099e72052 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151506 Oct 19 22:22:36.434673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1462/2913] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:36 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:36.446923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:36.447552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:36.453366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.453845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.454277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.454972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.455435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.455856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.517185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:36.517798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:36.524341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.524832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.525274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.525960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.526418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.526848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.589717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:36.591015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:36.598533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed6a9586-b606-4eed-b9a2-f00181530e0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.155692 Oct 19 22:22:36.599259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1452/2914] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:36.599451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0f52656e-8faa-40c7-8e1b-54d44e6cab39 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085984 Oct 19 22:22:36.600012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1463/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:36.791125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:36.791737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:36.797673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.798155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.798583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.799299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:36.799756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:36.800207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:36.925568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:36.936334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d640012b-a4c5-4548-8173-0837755e5847 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149204 Oct 19 22:22:36.936907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1453/2916] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:37.381179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:37.381793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:37.388098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.388573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.388999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.389677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.390120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.390538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.457141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:37.457770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:37.464772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.465248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.465676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.466356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.466799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.467244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.519672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:37.528958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:37.530414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:37.531599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a3e07370-8c33-4428-b025-c8ac24f623f5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154937 Oct 19 22:22:37.532358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1464/2917] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:37.599099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:37.607287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6459ac6c-0c1b-4eaf-9c7c-33778480dc76 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153968 Oct 19 22:22:37.607851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1454/2918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:37 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:37.621506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:37.621731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:37.622111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:37.622235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:37.628218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.628383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.628697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.628845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.629124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.629250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.629799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.629916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.630900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.631055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.631348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.631482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.692603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:37.701531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3c5fd7f4-7449-42a7-8628-55506b3d28e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083832 Oct 19 22:22:37.702095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1455/2919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:37.759290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:37.767538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-619b210c-5043-4ec0-bcdb-90f67cdcdcfc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149836 Oct 19 22:22:37.768104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1465/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:37.959286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:37.959902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:37.965797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.966280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.966721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:37.967433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:37.967891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:37.968317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.094172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:38.102754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-88ed8bee-654c-4523-9a4d-4bddf4d705ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147644 Oct 19 22:22:38.103342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1456/2921] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:38.557152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:38.557761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:38.564267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.567397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.567397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.567397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.567397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.567834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.633599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:38.634288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:38.640881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.641363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.641883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.642531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.643036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.643462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.695039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:38.703746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:38.705189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:38.706353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bed19a1e-dfa1-4d9f-b18d-acdbdc6f9be5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153139 Oct 19 22:22:38.706918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1466/2922] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:38.727158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:38.727763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:38.733602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.734109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.734540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.735246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.735693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.736114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.776456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:38.784941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7861d148-8749-4d4d-8c11-6c340c1f784a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155550 Oct 19 22:22:38.785693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1457/2923] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:38 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:38.794772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:38.795480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:38.801649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.802265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.802700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.803429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:38.803880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:38.804294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:38.804408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:38.812770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6f15f569-1020-4cdb-bdf8-97bec83f07ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.092391 Oct 19 22:22:38.813338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1467/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:38.930122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:38.938140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-667049f2-17fd-4b88-b6cb-d8f9770c8440 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150124 Oct 19 22:22:38.938693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1458/2925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:39.126163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:39.126700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:39.132618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.133097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.133537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.134218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.134670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.135124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.263489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:39.272167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d8ff74ba-9414-4b7d-87e8-a8102b11a400 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149918 Oct 19 22:22:39.272728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1468/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:39.732972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:39.733581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:39.739981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.740461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.740894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.741577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.742030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.742454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.808841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:39.809516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:39.815941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.816415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.816840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.817516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.818629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.818926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.873045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:39.882224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:39.883702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:39.884863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-60e5c84f-34ab-48ad-aaaa-92808b6faad6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155858 Oct 19 22:22:39.885426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1459/2927] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:39.889750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:39.890349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:39.897377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.897726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.898157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.898842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.899337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.899761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.914684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:39.951134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:39.960125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-447e7a45-4eba-4363-98d4-68727bc00406 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155085 Oct 19 22:22:39.960704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1469/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:39 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:39.964569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:39.965248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:39.965852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:39.971760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.972307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.972954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:39.973266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0c989593-70c9-4c23-b329-b7fef5607850 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086885 Oct 19 22:22:39.973641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:39.973825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1460/2929] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:39.974679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:39.975155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:40.104466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:40.112848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76d76cfe-7ef7-44b0-914a-4db345222805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151211 Oct 19 22:22:40.113409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1470/2930] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:40.297929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:40.298493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:40.304560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:40.305048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:40.305515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:40.306201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:40.306653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:40.307115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:40.432513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:40.440607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4ad0701c-85d5-4a73-800a-b14bf67f72ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146637 Oct 19 22:22:40.441160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1461/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:40.913716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:40.914318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:40.920734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:40.921211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:40.921640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:40.922315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:40.922758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:40.923198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:40.984809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:40.985404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:40.992407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:40.992962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:40.993399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:40.994094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:40.994539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:40.994971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:41.052730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:41.061467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:41.062886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:41.064070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-51b76643-7bfe-47bf-bd5b-45334c0bde39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154319 Oct 19 22:22:41.064824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1471/2932] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:41.068900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:41.069755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:41.075391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:41.075867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:41.076299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:41.076979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:41.077427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:41.077843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:41.137728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:41.140030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:41.145929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5c542929-fed6-4a1c-8974-d491a5518111 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.165101 Oct 19 22:22:41.146482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1462/2933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:40 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:41.148643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-040b0bf2-928b-452a-80e1-bef83a533df4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082974 Oct 19 22:22:41.149343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1472/2934] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:41.150857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:41.151612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:41.157144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:41.157618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:41.158044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:41.158719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:41.159190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:41.159609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:41.285262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:41.294123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3f31e375-9c74-4f52-99c6-3461fd14341b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146664 Oct 19 22:22:41.294684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1463/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:41.464398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:41.465010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:41.471029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:41.471513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:41.471948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:41.472629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:41.473078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:41.473497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:41.604493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:41.613031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e29acdb1-c7fd-4164-8c9b-961d2f2d170f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152404 Oct 19 22:22:41.621046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1473/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:42.090036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:42.090577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:42.097243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.097731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.098167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.098897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.099336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.099763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.170028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:42.170650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:42.177655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.179054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.179054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.179433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.179646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.180068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.234236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:42.244707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:42.246178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:42.247365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a85ed212-8152-4c62-bd28-70d15a427408 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161258 Oct 19 22:22:42.247994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1464/2937] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:42.263949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:42.264759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:42.270749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.274820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.274820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.274820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.274820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.275376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.309475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:42.318654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e97d4517-5d66-4263-bc17-7a1b744b66de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152148 Oct 19 22:22:42.319510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1474/2938] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:42 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:42.324087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:42.332175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:42.332175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.332175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.332175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.332590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.334496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.335013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.335284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:42.343620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-769aa7d7-b403-43ef-94fe-bdaa91e86cb2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083520 Oct 19 22:22:42.344126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1465/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:42.464171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:42.472312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-93a95a1b-cfb1-4a3f-b457-f53e92e656e4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151859 Oct 19 22:22:42.472888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1475/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:42.636254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:42.636774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:42.642985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.643477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.643915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.644586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:42.645032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:42.645446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:42.775658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:42.784400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bbe41135-d103-40be-ba06-fb13ff4883e6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151995 Oct 19 22:22:42.789427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1466/2941] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:43.272774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:43.273363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:43.279868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.280350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.280782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.281461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.281916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.282336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.341616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:43.342215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:43.348734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.349222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.349662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.350358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.350826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.351278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.410385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:43.412676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:43.419713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:43.421185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:43.428058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4aeb6d6-4241-455b-8232-c325210f0cad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154034 Oct 19 22:22:43.428058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1476/2942] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:43.428058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:43.428058 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:43.433814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.434492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.435227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.435985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.436519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.436894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.484636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:43.494045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82bef910-bef9-4d93-b440-25482790a85f tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156301 Oct 19 22:22:43.494612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1467/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:43 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:43.499056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:43.499657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:43.506582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.507313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.507627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:43.507764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.508433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.509009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.509491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.515924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b01af73-468e-45de-8a86-dd151bb801d4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.092024 Oct 19 22:22:43.516748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1477/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:43.639048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:43.647681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7e16745e-0de8-4ad3-b4e6-33dcd8c3b6f9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152124 Oct 19 22:22:43.648235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1468/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:43.811073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:43.811722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:43.817697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.818203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.818635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.819621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:43.820050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:43.820472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:43.948946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:43.957090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-871dc941-39c5-4f3f-98c4-1659f59a33fc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150045 Oct 19 22:22:43.957656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1478/2946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:44.452886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:44.453510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:44.459967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.460437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.460865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.461537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.461986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.462402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.516826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:44.517429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:44.523795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.524277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.524707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.525386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.525833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.526250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.589346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:44.597998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:44.599484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:44.600945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4c50cd60-c962-4d3a-b772-fb6a70411849 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152027 Oct 19 22:22:44.604851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1469/2947] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:44.609427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:44.610032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:44.616573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.617063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.617499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.618183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.618634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.619081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.657867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:44.666243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-22cdc743-f9d9-494f-b0ca-cad1bf214bc4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153193 Oct 19 22:22:44.666845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1479/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:44 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:44.671312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:44.671939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:44.678264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.678750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.679204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.679887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.680338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.680762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.684085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:44.692179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a641b036-233d-4783-8919-997aad4e3ac8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086333 Oct 19 22:22:44.693290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1470/2949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:44.813732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:44.822041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f2e2d4ca-b006-4fe9-978f-86d322e8345b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154244 Oct 19 22:22:44.822608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1480/2950] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:44.980548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:44.981154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:44.987036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.987509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.987938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:44.988612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:44.989058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:44.989484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.113964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:45.121982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8fb27027-ed64-408e-97d4-51b53288b51a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145247 Oct 19 22:22:45.122533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1471/2951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:45.625578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:45.626295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:45.633320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.633789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.634482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.635180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.635630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.636043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.689620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:45.690212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:45.697590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.698067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.698498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.699372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.699823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.700270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.765299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:45.774766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:45.776221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:45.777791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3998e2f0-c163-40cd-8613-6e33caf89f56 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155662 Oct 19 22:22:45.777917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1481/2952] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:45.782352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:45.782966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:45.792575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.792575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.792575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.792575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.793627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.796141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.838615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:45.846944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4bccc6d7-3f9a-46a3-ae63-4ca96185f2d8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.161092 Oct 19 22:22:45.847546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1472/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:45 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:45.852072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:45.852675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:45.858279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.858758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.859223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.859906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:45.860360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:45.860779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:45.868976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:45.877134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8b70907d-e2aa-4acd-aa6f-263e720bc162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.098225 Oct 19 22:22:45.877637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1482/2954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:45.986594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:45.995205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0650ba83-dbc5-4be2-a699-ba04c5c15898 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146693 Oct 19 22:22:45.995778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1473/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:46.145337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:46.145871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:46.151826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:46.152304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:46.152734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:46.153412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:46.153867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:46.154287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:46.284908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:46.293677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-673ed302-dfc1-4a86-92ea-21d8c054c254 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152237 Oct 19 22:22:46.294248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1483/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:46.803621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:46.804225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:46.810657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:46.811179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:46.811613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:46.812286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:46.812735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:46.813148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:46.869563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:46.870182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:46.876611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:46.877099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:46.877537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:46.878228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:46.878687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:46.879141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:46.998582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:47.007495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:47.008918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:47.010076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2cf1446c-21b2-4591-bccc-0b1d6574fc80 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.210354 Oct 19 22:22:47.010635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1474/2957] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:47.012369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:47.020260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:47.021304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1c089c3a-18e1-4f62-833c-a4cbf2e0c60a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155046 Oct 19 22:22:47.021432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:47.022023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1484/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:46 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:47.026502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:47.027138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:47.027412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:47.027895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:47.028344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:47.029032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:47.029848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:47.029973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:47.032835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:47.033320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:47.033759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:47.034463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:47.034921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:47.035381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:47.095680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:47.103927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-02c62fe3-6cd0-4f64-9bf8-3cbb38491bf8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087313 Oct 19 22:22:47.104497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1475/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:47.164162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:47.172296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-45aaa002-69c1-42f7-83d2-261cc771fa69 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149414 Oct 19 22:22:47.172855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1485/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:47.316919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:47.320125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:47.320256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:47.324837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:47.325318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:47.325759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:47.326447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:47.326901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:47.327363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:47.455567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:47.463742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9bc68a43-aa2f-46c2-aa42-2f3f5e21d539 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150732 Oct 19 22:22:47.464305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1476/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:48.047971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:48.048518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:48.050530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:22:48.050685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:22:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 (ip 10.222.0.20) !!! Oct 19 22:22:48.050871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:48.052625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:48.061934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.062414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.062843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.063460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.063590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.063946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.064076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.064391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.064533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.065072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.065527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.065951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.068416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:48.193432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:48.195411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:48.202495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:48.203594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-428f873f-4b39-49e8-81ae-836e30661a1c tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.156497 Oct 19 22:22:48.203948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:48.204165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1477/2962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:48 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:48.217273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-db1b03d8-6462-46c8-bb8a-de2792c0a27a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161458 Oct 19 22:22:48.217273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1486/2963] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:48.217526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:48.217526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:48.217708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:48.217708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:48.217885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.217885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.218061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:48.218154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.218268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.218363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.220714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.227252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.227252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.227503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.227611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.227611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.227611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.284598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:48.293429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d827e139-88f5-4e9f-b134-5275894ab435 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088315 Oct 19 22:22:48.294000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1478/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:48.348725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:48.357625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-74ec8313-897c-4c1f-bd24-1e6662749cdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150909 Oct 19 22:22:48.358191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1487/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:48.486464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:48.487112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:48.492998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.493474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.493904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.494581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:48.495057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:48.495480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:48.620969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:48.629302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-68e419b4-1fa8-4f92-8577-d56d27efe35c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146660 Oct 19 22:22:48.629858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1479/2966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:49.228242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:49.228868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:49.231815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:49.232421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:49.235329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.235510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:22:49.235655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.235775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:22:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 (ip 10.222.0.20) !!! Oct 19 22:22:49.235957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.236962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.237177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.237656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.240994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.241459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.241880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.242561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.243062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.243482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.372852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:49.382098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:49.383548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:49.384716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-173e52d2-67a3-4ef7-ba18-82dfbda7ffb6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156662 Oct 19 22:22:49.385277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1480/2967] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:22:49.398685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:49.399333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:49.405035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.405515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.405943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.406626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.407108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.407530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.418024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:49.426195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-35b3bb35-f058-4fea-9656-82c7f0b03178 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.202598 Oct 19 22:22:49.426760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1488/2968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:49 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:49.431155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:49.431762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:49.437490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.437978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.438420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.439146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.439601 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.440025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.472612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:49.481068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ff6c7e2-dcb7-4b33-af7b-f42e6848f6bc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.094778 Oct 19 22:22:49.481567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1481/2969] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:49.566643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:49.575926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f5aaa6cc-9592-45cd-917f-ef8c4d6f9e26 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148187 Oct 19 22:22:49.576522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1489/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:49.652819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:49.653426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:49.659298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.659770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.660195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.660867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:49.661310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:49.661727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:49.785533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:49.793899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a6f8ec92-6238-4112-9355-8304f932f47c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.144872 Oct 19 22:22:49.794498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1482/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:50.409900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:50.410434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:50.417325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.417796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.418223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.418896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.419370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.419786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.449686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:50.450291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:50.456384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.456861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.457286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.457968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.458940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.459378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.550266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:50.558829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:50.560279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:50.561425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-93517eb2-e4ea-4b16-875c-2fa19d7a5f84 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155485 Oct 19 22:22:50.568543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1490/2972] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:50.568543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:50.568543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:50.572941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.573428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.573862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.574541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.575010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.575433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.587768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:50.596244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-627f6652-1e89-499c-ad00-480bffa30393 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150310 Oct 19 22:22:50.596973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1483/2973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:50 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:50.602432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:50.603087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:50.608867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.609355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.609790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.610599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.611079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.611508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.649903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:50.658120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9fd1b8bf-71e9-4853-a471-f4c473932ee3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.095183 Oct 19 22:22:50.658692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1491/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:50.742157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:50.750255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2a39b5f-94bf-4efe-b770-8c7109c4694a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152470 Oct 19 22:22:50.750815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1484/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:50.817157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:50.818264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:50.824581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.825063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.825495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.826178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:50.826628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:50.827078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:50.952809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:50.961549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-858908ee-fc64-4d5c-8938-4e44518d38b8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148218 Oct 19 22:22:50.962116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1492/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:51.587865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:51.588475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:51.594918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.595425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.595855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.596534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.596986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.597410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.619687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:51.620302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:51.626797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.627324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.627763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.628456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.628917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.629504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.645059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:51.727202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:51.735807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:51.737252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:51.738459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fe984543-7310-49f9-bdc4-4e846fb60217 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155101 Oct 19 22:22:51.739001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1485/2977] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:51.751117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:51.751117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:51.751117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.751117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.751578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.751578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.751775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.752165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.765171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:51.774208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-702cff42-f287-4a44-8193-c0e6eac1608e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.158422 Oct 19 22:22:51.774786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1493/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:51 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:51.779294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:51.779905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:51.785762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.786592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.786715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.788069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.788069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.788424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.815671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:51.824632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-43a0c6d0-82ab-432b-8e27-faf1e117606d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084675 Oct 19 22:22:51.825238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1486/2979] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:51.916494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:51.924890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f40c51b3-5644-46bc-b3e2-346e2f04cd7d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149149 Oct 19 22:22:51.925459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1494/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:51.983803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:51.984439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:51.990941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.991448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.991921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:51.992611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:51.993067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:51.993492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.121271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:52.129342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5e41c640-847a-40f6-97fc-bced8442d3a2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149401 Oct 19 22:22:52.129900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1487/2981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:52.765477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:52.766088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:52.772574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.773056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.773492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.774180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.774632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.775084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.796909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:52.797711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:52.804627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.805109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.805544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.806232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.806680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.807233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.908474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:52.917290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:52.918787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:52.920000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ad6c893a-04d5-49f6-9079-798ac022089b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158465 Oct 19 22:22:52.920559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1495/2982] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:52.924886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:52.925892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:52.931612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.932097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.932534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.935494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.935800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:52.936106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.936547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.945269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-61df0e65-110d-46d3-aaf7-416b93eebcc2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152194 Oct 19 22:22:52.945848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1488/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:52 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:52.950276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:52.950881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:52.957767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.958812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.959282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:52.959973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:52.960701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:52.961133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:53.098929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:53.107523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a670c225-cf06-4aee-8d1b-057615d16289 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.160649 Oct 19 22:22:53.108103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1489/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:53.153206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:53.153907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:53.160134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:53.160701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:53.161203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:53.161957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:53.162470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:53.162997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:53.217492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:53.225781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0ddd785f-308f-4138-a70d-00a894a89e73 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.304266 Oct 19 22:22:53.226353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1496/2985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:53.294594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:53.302645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa81bbdc-31ea-4180-94f4-11a9b2b76433 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153346 Oct 19 22:22:53.303226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1490/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:53.946353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:53.946984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:53.953536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:53.954021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:53.954461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:53.955189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:53.955646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:53.956070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:53.968306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:53.968919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:53.975826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:53.976307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:53.976746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:53.977431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:53.977908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:53.978307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:54.084351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:54.093045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:54.094495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:54.096082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9813904-2262-4713-a126-1a4072717afe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153884 Oct 19 22:22:54.096656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1497/2987] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:54.108974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:54.117685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf430b97-9a64-4b55-9564-b6c7a6ec4599 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153250 Oct 19 22:22:54.118241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1491/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:53 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:54.130503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:54.131147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:54.137251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:54.137739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:54.138174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:54.138860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:54.139343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:54.139765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:54.247985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:54.248597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:54.254425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:54.254909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:54.255379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:54.256077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:54.256529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:54.256952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:54.269957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:54.278629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a357e8b2-1d67-4bd7-ac9f-230b021c4155 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151985 Oct 19 22:22:54.279228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1498/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:54.325760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:54.326051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:54.326735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:54.333798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:54.334284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:54.334735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:54.335282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b7b0f255-9472-4d76-b55d-f9129e956cea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.091003 Oct 19 22:22:54.341180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:54.341317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1492/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:54.341424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:54.341424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:54.462375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:54.470672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f2aa41e-4005-4295-9baf-1fcdba63d773 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148666 Oct 19 22:22:54.471285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1499/2991] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:55.121740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:55.122281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:55.129171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.129657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.130668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.131386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.131844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.132275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.140280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:55.141036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:55.147392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.147872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.148312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.148999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.149451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.149873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.265590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:55.267796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:55.274720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:55.276181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:55.282251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-96f83d90-53ad-41f0-8d42-0500b37a662e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.159610 Oct 19 22:22:55.282251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1493/2992] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:55.282618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:55.291457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-64cdd13f-a1c6-4fc9-8d4e-3033e959e3de tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154912 Oct 19 22:22:55.296175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1500/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:55 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:55.305521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:55.305521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:55.310804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.311311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.311741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.312559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.313008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.313421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.358406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:55.359032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:55.365616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.366095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.366521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.367331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.367740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.368153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.431081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:55.439389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f131558b-1f0a-4dd6-b1bf-2a786e793a6f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084712 Oct 19 22:22:55.439969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1501/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:55.444786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:55.452993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6f93eaf2-10a1-4bc8-82cc-69f04b52ee38 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153927 Oct 19 22:22:55.453543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1494/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:55.495239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:55.495852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:55.501758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.502241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.502678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.503392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:55.503844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:55.504269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:55.629205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:55.638028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b520cbf-56eb-44e7-865f-0a54b555eab0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146639 Oct 19 22:22:55.638600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1502/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:56.303665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:56.304280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:56.310724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.311238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.311681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.312369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.312825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.313250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.315204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:56.315820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:56.322983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.323457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.323891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.324585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.325034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.325456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.443230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:56.452061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:56.453515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:56.454682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9f77e30-f497-4021-920d-7eac30aef626 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154921 Oct 19 22:22:56.455528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1495/2997] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:56.455665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:56.461316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:56.461853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:56.464604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-419ccfaf-82c7-4457-ab0f-f54632722bac tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153114 Oct 19 22:22:56.465334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1503/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:56 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:56.468176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.468756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.470472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.470472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.471137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.471631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.478793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:56.479469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:56.485256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.485743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.486182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.486879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.487363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.487786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.533344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:56.541461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-55aff8e3-7407-4f2f-978b-943e82403c0d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083892 Oct 19 22:22:56.542031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1496/2999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:56.615806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:56.623964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f9784af0-fa28-41b9-850b-deaeeb81931e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148828 Oct 19 22:22:56.624539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1504/3000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:56.661122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:56.661738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:56.667611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.668095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.668540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.669223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:56.669680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:56.670107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:56.799383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:56.808252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09855123-ed06-49c8-9b3c-3d63d650c927 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150901 Oct 19 22:22:56.808813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1497/3001] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:57.480874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:57.481510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:57.487093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:57.487721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:57.487915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.488393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.488828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.489544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.489990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.490414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.494007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.494489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.494923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.495639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.496094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.496522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.618146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:57.626049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:57.626683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:57.628161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:57.629322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0bac7f52-144d-4bbd-aef7-7946431621b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152390 Oct 19 22:22:57.629887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1505/3002] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:57.634928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:57.635911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:57.636804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a07caf5-a4e8-40db-85a6-270b11ebe27a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152513 Oct 19 22:22:57.647006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.647006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.647006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.647006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.647436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.647436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.648116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1498/3003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:57 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:57.652862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:57.653474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:57.659369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.659851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.660284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.660965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.661418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.661833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.709573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:57.717734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c0941bc5-d24a-4be7-be7c-49e0035c9887 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086385 Oct 19 22:22:57.718325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1506/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:57.792596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:57.801167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-32e8810e-54bb-466c-bea1-1b7ecb27ba51 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151845 Oct 19 22:22:57.801758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1499/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:57.831144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:57.831693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:57.838183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.838656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.839116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.839796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:57.840249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:57.840664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:57.966383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:57.974451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2afed2f0-889f-463c-827d-91e995018f63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147206 Oct 19 22:22:57.975041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1507/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:58.655861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:58.656538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:58.661936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:58.662660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:58.663685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.664167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.664597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.665290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.665755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.666179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.669128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.669608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.670043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.670727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.671238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.671657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.796759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:58.802799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:58.805285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:58.806715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:58.807889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4271662f-f3ba-4bd0-bd5e-952671a1ed78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155974 Oct 19 22:22:58.808442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1500/3007] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:58.812099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6e9f4a1-08a3-41b5-84c0-f88306e21366 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154455 Oct 19 22:22:58.812998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:58.813152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1508/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:58 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:58.813535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:58.820675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.820675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.820675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.821010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.821451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.821870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.833039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:58.834324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:58.841103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.842194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.842686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.843366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:58.843848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:58.844417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:58.884516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:58.892946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-959e671a-549b-4928-b8f8-84c17bedb87a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083516 Oct 19 22:22:58.893710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1501/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:58.981508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:58.989586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-319e0456-36bc-48e9-a826-27b6a7334eab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.161330 Oct 19 22:22:58.990149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1509/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:58.997379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:58.997981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:59.003802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:59.004278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:59.004711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:59.005430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:59.005907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:59.006323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:59.138026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:59.146925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-71e281e6-8411-468d-83fb-fa132c982a6d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153303 Oct 19 22:22:59.147513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1502/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:22:59.833644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:59.834281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:59.834811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:59.835458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:59.842028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:59.842317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:59.842514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:59.842640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:59.842946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:59.843093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:59.843671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:59.843789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:59.844122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:59.844546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:59.844958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:59.845395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:22:59.851402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:22:59.976971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:59.978632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:59.985350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7fc16cf7-c699-4b5f-9766-b1417cdda634 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154226 Oct 19 22:22:59.986008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1503/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:59 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:22:59.987311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:59.988765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:22:59.990840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5df318fb-a3f4-4676-8001-55183e99eca8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161106 Oct 19 22:22:59.991589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1510/3013] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:22:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:22:59.992007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:22:59.992757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:22:59.998440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:22:59.999020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:22:59.999677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:00.000426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:00.000944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:00.001426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:00.012933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:00.013548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:00.019795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:00.020283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:00.020790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:00.021621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:00.022080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:00.022507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:00.066141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:00.075368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b83ef633-87b2-4494-91ca-264f9b1bef7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088303 Oct 19 22:23:00.077499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1504/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:22:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:00.154699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:00.163419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6d8d710b-b56e-4639-912e-39e72cdfb359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154670 Oct 19 22:23:00.163982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1511/3015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:00.169436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:00.170080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:00.176078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:00.178716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:00.178716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:00.178716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:00.179306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:00.179751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:00.307410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:00.315499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a733a725-7785-4106-9617-ca9b3300949b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149799 Oct 19 22:23:00.315976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1505/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:01.010140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:01.010799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:01.015958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:01.016566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:01.017505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.018001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.018570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.019302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.019762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.020188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.022859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.023370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.023799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.024482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.024928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.025372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.155506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:01.158250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:01.163918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2b2a08f1-2e7f-4951-91b8-4a465284b7a6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.157636 Oct 19 22:23:01.164483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1512/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:01 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:01.167675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:01.168960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:01.169415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:01.169550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:01.170733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ced05d40-bb00-4e4f-9bd3-775ad262a86e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158599 Oct 19 22:23:01.171526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1506/3018] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:01.175082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.175564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.175991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.177320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.177746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.178296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.186828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:01.187472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:01.193869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.194351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.195097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.195789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.196246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.196676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.244063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:01.252234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-12c6e5b0-9416-48eb-9d35-df8ca82305ec tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086821 Oct 19 22:23:01.252881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1513/3019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:01.329689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:01.337488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:01.338030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fc48b726-4eef-4f0d-a16b-c32731e30f57 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154774 Oct 19 22:23:01.338561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:01.338768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1507/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:01.344488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.344971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.345406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.346091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:01.346542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:01.346974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:01.475194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:01.483347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-328e72ed-8c17-4540-9f5e-7f6bd200ae22 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149603 Oct 19 22:23:01.483911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1514/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:02.190804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:02.190804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:02.194223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.194967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.195425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.196121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.196575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.197000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.197317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:02.197924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:02.204613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.205098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.205534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.206226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.206677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.207137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.329180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:02.337857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:02.338131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1a7ced01-b236-424d-a3e2-35062aca3d07 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.155475 Oct 19 22:23:02.338705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1508/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:02 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:02.353754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:02.353754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:02.354003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:02.354003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:02.354003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3bc399d6-25a6-487f-982b-a14c4f4e1665 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156669 Oct 19 22:23:02.354326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.354326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.354529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1515/3023] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:02.354644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.354644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.354644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.354644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.363499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:02.364444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:02.370556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.371215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.371645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.372328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.372775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.373194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.415194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:02.423393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-da3dfc70-0ce6-41ce-9900-5298c4259bfd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083604 Oct 19 22:23:02.423970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1509/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:02.503381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:02.507259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:02.507882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:02.512431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6584e1b-f7ca-403a-bb6e-d69988509f19 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153425 Oct 19 22:23:02.512996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1516/3025] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:02.513674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.514175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.514614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.515378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:02.515838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:02.516269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:02.531150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:02.644346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:02.652435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0cace82d-192c-460c-abae-b75413b84368 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149589 Oct 19 22:23:02.652998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1510/3026] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:03.361278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:03.361893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:03.368382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.368863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.369297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.369978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.370429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.370850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.375241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:03.375852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:03.382630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.383151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.383584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.384267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.384714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.385131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.500567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:03.508681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-34caeaef-a87b-488c-ba65-2c1e2e8ca5e6 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151288 Oct 19 22:23:03.509267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1517/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:03 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:03.512992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:03.523763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:03.523763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:03.523763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.523763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.524168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.524269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:03.524382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.524382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.524382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.524640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:03.524851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4b2c4011-a8f1-4095-9ce3-4dc7192d2192 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153439 Oct 19 22:23:03.525405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1511/3028] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:03.535270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:03.536078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:03.542668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.543194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.543625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.544312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.544764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.545187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.589900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:03.597892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18fcbd93-ca2e-4020-a7cf-73242f84c1ff tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087707 Oct 19 22:23:03.598461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1518/3029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:03.672163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:03.674585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:03.675223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:03.680688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a2bfd37c-d111-4f6a-8c12-1cebced5e8eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149127 Oct 19 22:23:03.681063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.681542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.681681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1512/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:03.682022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.682714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:03.683184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:03.683603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:03.812207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:03.821328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-951b8011-8ae3-4ccf-a17b-299d2e6dd4d5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150538 Oct 19 22:23:03.821924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1519/3031] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:04.545808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:04.546433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:04.551610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:04.552836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:04.553714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.554204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.554644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.555395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.555856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.556289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.559691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.560168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.560600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.561280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.561727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.562144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.687946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:04.690335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:04.696868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8209afda-2a1c-475e-b359-fa387dfc1c7e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154837 Oct 19 22:23:04.697632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1513/3032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:04 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:04.699425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:04.701252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:04.702425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7f4dcc31-d294-417d-b383-003525232ead tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154947 Oct 19 22:23:04.710502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:04.710704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1520/3033] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:04.710815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:04.710917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:04.710917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:04.711144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.711144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.711426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.712110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.712557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.712988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.716912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.717400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.717837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.718536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.719014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.719444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.774697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:04.782904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3992c27f-e1b2-4275-bfac-b231f28c7761 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084254 Oct 19 22:23:04.783679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1514/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:04.844894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:04.845500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:04.850914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:04.851961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.852442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.852873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.853559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:04.854007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:04.854426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:04.859273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cc530ecc-86c1-44a9-8e6d-1157681b8dd0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.155058 Oct 19 22:23:04.859840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1521/3035] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:04.981258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:04.989258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c6d0435-e1d9-428c-a18b-8fdd2be20b74 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148242 Oct 19 22:23:04.989815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1515/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:05.720802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:05.721406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:05.727940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.728425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.728554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:05.728962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.729072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:05.729530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.729981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.730399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.735459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.735942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.736372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.737049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.737491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.737908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.861635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:05.863588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:05.870551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ea88a12e-3cc4-4b35-8cb4-10cbb5e0d0e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153652 Oct 19 22:23:05.871150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1522/3037] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:05 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:05.872683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:05.874118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:05.875295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8fcdce87-de2b-4f83-8054-70d652ae6662 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150713 Oct 19 22:23:05.878163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:05.878778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:05.887178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1516/3038] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:05.888104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.888598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.889037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.889738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.890195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.890622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.891916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:05.892560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:05.898342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.898818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.899280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.899959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:05.900402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:05.900819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:05.953285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:05.961809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d07ed187-2d9a-4d34-bd4d-b897438f89b1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089693 Oct 19 22:23:05.962381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1523/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:06.011814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:06.012550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:06.018275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:06.018759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:06.019228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:06.019945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:06.020395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:06.020849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:06.028068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:06.036726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-292054c4-e403-4779-91ab-e86eb58bfbe2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148006 Oct 19 22:23:06.037300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1517/3040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:06.148915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:06.156974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7a9f5f28-d1b9-4f13-8ba4-fbc21afb5fb6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148976 Oct 19 22:23:06.157543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1524/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:06.893433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:06.894072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:06.901193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:06.901672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:06.902105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:06.902253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:06.902798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:06.902912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:06.903272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:06.903696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:06.909177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:06.909656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:06.910089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:06.910765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:06.911232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:06.911649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:07.035928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:07.038425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:07.044225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa3c31f8-0be5-4f0d-a26e-8cd0a07ceb8d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154642 Oct 19 22:23:07.044794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1518/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:06 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:07.046886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:07.048355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:07.049146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:07.049514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b9e740a6-9ab0-4f78-8dd0-7e8032199769 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151232 Oct 19 22:23:07.049741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:07.050205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1525/3043] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:07.056632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:07.057114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:07.057549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:07.058232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:07.058684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:07.059136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:07.068568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:07.069224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:07.082375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:07.082869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:07.083357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:07.084063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:07.084523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:07.084943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:07.120368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:07.128653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-324c550f-4907-4427-b5ca-a72a44ccd617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082894 Oct 19 22:23:07.129220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1519/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:07.180429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:07.181072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:07.186912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:07.187437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:07.187887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:07.188580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:07.189143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:07.189594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:07.216379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:07.218566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:07.225295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-68559f61-2b9b-4702-b364-8557cf72cb5e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.161008 Oct 19 22:23:07.225872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1526/3045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:07.318817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:07.327322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e24871f0-d542-4adc-8733-99c449b11a89 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151120 Oct 19 22:23:07.327886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1520/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:08.070261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:08.070888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:08.076196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:08.076820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:08.077999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.078483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.078931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.079632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.080085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.080507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.083879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.084413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.084862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.085575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.086035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.086468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.214331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:08.218413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:08.222847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8ed73956-9eb5-4690-9f1c-fcde0205caf3 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.157326 Oct 19 22:23:08.223455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1527/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:08 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:08.227584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:08.227869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:08.228481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:08.229295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:08.230539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b54af63d-d528-436b-be13-31ab4d5e69e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158192 Oct 19 22:23:08.231493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1521/3048] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:08.236292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.236773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.237202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.237882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.238328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.238740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.248022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:08.248630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:08.254383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.255745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.255923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.256517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.256974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.257406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.300016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:08.308414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e113a9eb-1912-4bd5-bd47-77c4d36c89bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083998 Oct 19 22:23:08.308976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1528/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:08.349515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:08.350230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:08.356142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.356622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.357081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.357759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:08.358203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:08.358618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:08.385081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:08.393630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-801810d9-e9eb-4c32-893b-1369032bd258 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149194 Oct 19 22:23:08.394198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1522/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:08.488775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:08.497427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-652d6420-5e1e-4b27-b98f-4528a96d59ec tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151731 Oct 19 22:23:08.497983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1529/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:09.245827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:09.246439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:09.252997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.253482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.253919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.254606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.255094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.255402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:09.255833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.256015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:09.262346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.262826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.263290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.263993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.264437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.264853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.392047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:09.392769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:09.401862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82e6056e-57ea-481c-8abc-d3647de68a0d tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.159906 Oct 19 22:23:09.402059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:09.402438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1523/3052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:09 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:09.403436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:09.404768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1d20cc45-bc49-4264-a153-e390ccf7a771 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153273 Oct 19 22:23:09.405447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1530/3053] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:09.407366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:09.407982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:09.415068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.415555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.415990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.416672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.417258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.417701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.426145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:09.426798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:09.432737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.433214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.433645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.434331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.434767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.435210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.479526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:09.487648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0f7f7d60-9b67-4494-870e-2beab9458d15 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084266 Oct 19 22:23:09.488215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1524/3054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:09.521517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:09.522125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:09.527942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.528422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.528849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.529528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:09.529972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:09.530420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:09.563713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:09.572891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d0ea4a74-ef5b-4ff5-9fb9-88ea28ee1d14 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151762 Oct 19 22:23:09.573768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1531/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:09.654817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:09.662833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-84762066-31dc-43b7-946c-91183344debd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145705 Oct 19 22:23:09.663423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1525/3056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:10.425453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:10.425999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:10.430141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:10.430752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:10.433021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.433182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:10.433502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.433938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.434614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.435086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.435505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.438121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.438607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.439070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.439758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.440228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.440638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.566634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:10.571767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:10.575090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d0264962-41f3-43aa-b0de-fc7428f2d921 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153565 Oct 19 22:23:10.575657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1532/3057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:10 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:10.579991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:10.580496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:10.580642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:10.581985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:10.583287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d22e14fd-f9a1-4965-bd08-a1d0d569d338 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157451 Oct 19 22:23:10.583863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1526/3058] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:10.586356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.586837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.587296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.587976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.588421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.588837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.596980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:10.598060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:10.604769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.605263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.605676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.606382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.606833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.607287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.611161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:10.651957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:10.660177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-549035f4-7fbd-41dd-897f-bed1fd8083f3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083561 Oct 19 22:23:10.660755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1533/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:10.685535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:10.686061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:10.691825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.692277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.692704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.693378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:10.693854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:10.694270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:10.741608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:10.749820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b33d1987-dc87-4b70-8d1a-bd165d883243 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.156665 Oct 19 22:23:10.750383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1527/3060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:10.825451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:10.833528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-88eca382-2517-466f-8c21-eb20b2b51ff1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151877 Oct 19 22:23:10.834588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1534/3061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:11.598924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:11.599556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:11.605976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.606459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.606896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.607611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.608070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.608498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.609050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:11.609657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:11.616657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.617130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.617559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.618242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.618693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.619210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.739961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:11.746300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:11.748837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-65cc830c-6dc3-42c2-87a1-d990d0aa0b4e tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.154162 Oct 19 22:23:11.749860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1528/3062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:11 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:11.753763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:11.754364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:11.755206 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:11.757217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:11.758374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6da32a39-d9dc-40b6-8fce-c3cb4c16f6a5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153257 Oct 19 22:23:11.759093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1535/3063] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:11.760626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.761117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.761556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.762239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.762697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.763146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.780096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:11.780739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:11.787096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.788097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.788569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.789228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.789693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.790118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.823969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:11.832242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bef4e5c5-212b-4185-8262-91993dafe35f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081877 Oct 19 22:23:11.832798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1529/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:11.856869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:11.857440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:11.863334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.863815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.864253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.864951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:11.866021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:11.866486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:11.919654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:11.928660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4f2e98fa-ed3c-4d86-9ff4-97f220317efb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151711 Oct 19 22:23:11.929449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1536/3065] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:11.992578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:12.000620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5fd0c3a8-0b60-4da5-8328-3120e1b7d775 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147705 Oct 19 22:23:12.001183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1530/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:12.772248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:12.772860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:12.775188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:12.779851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:12.780334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:12.780767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:12.781452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:12.781938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:12.782365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:12.783449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:12.784063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:12.791233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:12.791723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:12.792158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:12.792863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:12.793317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:12.793738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:13.076315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:13.089892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8b0e4cb7-1df6-4171-89de-a24516b4ff98 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.321441 Oct 19 22:23:13.090490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1537/3067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:12 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:13.094914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:13.095536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:13.102319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:13.102816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:13.103281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:13.103983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:13.104434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:13.104857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:13.140685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:13.149791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:13.151251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:13.152414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-21490f1c-c987-4570-9657-3d881cdb7303 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.372686 Oct 19 22:23:13.152975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1531/3068] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:13.157268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:13.157870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:13.165004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:13.165496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:13.165927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:13.166106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:13.166621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:13.167102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:13.167523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:13.174407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-04c3fe42-dda7-45fd-b233-bd89061eca97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082939 Oct 19 22:23:13.174988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1538/3069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:13.179415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:13.180042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:13.185595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:13.186077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:13.186509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:13.187208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:13.187658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:13.188078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:13.295374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:13.303506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-41b25e0d-f2c7-4c05-a0d8-6e60bfb820b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149588 Oct 19 22:23:13.304075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1532/3070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:13.319901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:13.328203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-89a89fbb-5612-4566-a085-707af0ea8161 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152287 Oct 19 22:23:13.328749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1539/3071] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:14.112575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:14.113181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:14.120315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.120817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.121250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.121929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.122381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.122803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.180521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:14.184673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:14.187866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.188347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.188776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.189485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.189931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.190408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.257583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:14.266024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9dc93a75-6770-42ec-b8a9-5cf1c8a2c770 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.157295 Oct 19 22:23:14.266590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1533/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:14 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:14.271007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:14.271705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:14.278411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.278901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.279357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.280039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.280491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.280916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.328683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:14.337329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:14.338757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:14.340224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e3989678-b930-400b-858a-e0d6447bc033 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.164774 Oct 19 22:23:14.340866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1540/3073] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:14.346283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:14.346283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:14.351081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:14.352628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.353104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.354090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.354228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.354662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.355109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.360042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c4fabb5e-aa81-45d5-b4b0-0512ee09ffcc tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.091208 Oct 19 22:23:14.360042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1534/3074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:14.363743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:14.364356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:14.370487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.370993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.371434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.372120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:14.372576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:14.373137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:14.485608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:14.493983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5764e721-3712-463b-bde5-6805dead1ca7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152144 Oct 19 22:23:14.499613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1541/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:14.501666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:14.509941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c24e4b82-347f-43b6-addf-f97af862869f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149615 Oct 19 22:23:14.510498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1535/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:15.289421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:15.290036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:15.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.297374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.297811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.298504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.298979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.299413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.366824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:15.367579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:15.373964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.374480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.374930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.375652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.376105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.376530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.435747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:15.444692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a151050b-2761-4da9-b784-4f52ff2f2526 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.159132 Oct 19 22:23:15.445533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1542/3077] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:15 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:15.449983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:15.450594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:15.457059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.458880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.458880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.458880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.459839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.459839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.476115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:15.511218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:15.519990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:15.521318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:15.522530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-34e22077-0d10-48f8-a5e4-06fff1475115 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.160151 Oct 19 22:23:15.522919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:15.523192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1536/3078] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:15.531615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e7ba95f9-87f3-4d84-803b-011611705a6b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085114 Oct 19 22:23:15.532346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1543/3079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:15.536783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:15.538034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:15.543661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:15.543826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.544160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.544304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:15.544591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.545267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.545755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.546198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.550709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.551373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.551810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.552496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:15.553597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:15.554021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:15.674307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:15.679428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:15.682523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e992c7b0-e965-433b-8533-1936036341d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149209 Oct 19 22:23:15.686991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1544/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:15.687543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e8fe4168-7e65-45e7-bc20-8c783cfdca76 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147585 Oct 19 22:23:15.688126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1537/3081] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:16.467883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:16.468522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:16.475454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.475944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.476380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.477080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.477514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.477937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.555705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:16.556724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:16.562724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.563232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.563666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.564376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.564829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.565251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.607140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:16.615414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-efdf3684-8a1a-4e39-906f-f1d7485020d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151410 Oct 19 22:23:16.616485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1545/3082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:16 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:16.620917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:16.621519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:16.627184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.627675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.628119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.628810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.628990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:16.629258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.629679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.637795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-080e1178-f485-4570-9e5d-e925404d2236 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086735 Oct 19 22:23:16.638491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1538/3083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:16.707038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:16.707734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:16.714174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.714757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.715302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.716060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.716587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.717091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.757711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:16.766446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:16.767910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:16.769073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9afbd628-8255-4635-9333-90d27ae986fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151680 Oct 19 22:23:16.769631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1546/3084] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:16.774552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:16.775187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:16.781012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.781801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.781931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.782615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:16.783100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:16.783520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:16.855136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:16.863241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6be6552f-d05a-4626-a285-6768d3090dc1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.160334 Oct 19 22:23:16.863820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1539/3085] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:16.917004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:16.925258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-40aca0f0-f6dc-4cfb-a259-148dd0540045 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154695 Oct 19 22:23:16.925814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1547/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:17.638793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:17.639434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:17.645876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.646357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.646796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.647511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.647969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.648402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.660799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:17.661406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:17.667739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.668216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.668645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.669324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.669769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.670187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.731317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:17.740180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-74820c30-381e-424d-9dc2-0f57ec4bcff3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083115 Oct 19 22:23:17.741766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1548/3087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:17.777429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:17.785559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9f20ca19-af37-4194-8ee6-54a25dbe3431 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150663 Oct 19 22:23:17.791821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1540/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:17 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:17.800320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:17.800933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:17.807839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.808320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.808766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.809427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.809873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.810288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.885608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:17.886212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:17.892179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.892681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.893090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.893768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.894216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.894634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.938839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:17.947895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:17.949329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:17.950489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e1d8ced1-0786-4d9e-9673-d86eebc7bfc6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154025 Oct 19 22:23:17.951064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1549/3089] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:17.955382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:17.955984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:17.961806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.962228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.962663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:17.963379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:17.964526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:17.964526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:18.028940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:18.037093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-95e8acf8-0fe1-4180-8151-e3e0378f8b08 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155289 Oct 19 22:23:18.038204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1541/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:18.094482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:18.103249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4033591-d863-4986-9476-9656345e6de8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151224 Oct 19 22:23:18.103816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1550/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:18.763411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:18.764118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:18.770527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:18.771034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:18.771526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:18.772780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:18.773233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:18.773656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:18.813543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:18.814184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:18.821010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:18.821499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:18.821936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:18.822653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:18.823118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:18.823550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:18.837988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:18.846258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9a87be42-b24a-4965-adef-92382b957039 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086679 Oct 19 22:23:18.846821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1542/3092] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:18.951286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:18.959480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-058f868a-b5c5-47d0-b1fa-ee5cf31b5794 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149910 Oct 19 22:23:18.960044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1551/3093] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:18 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:18.976847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:18.977453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:18.983321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:18.983800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:18.984233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:18.984911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:18.985362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:18.985784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.061498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:19.061986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:19.068209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.069339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.069792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.070728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.071203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.076374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.114134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:19.119410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:19.127662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:19.129206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:19.130456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5a52fede-ea94-4499-8d59-2b4516ef32ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157509 Oct 19 22:23:19.131963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1543/3094] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:19.136646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:19.137264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:19.143407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.143908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.144347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.145042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.145497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.145924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.207947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:19.216743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a93f8f2f-9455-43e7-bc59-7ef7d5bf4321 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.159150 Oct 19 22:23:19.217330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1552/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:19.277521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:19.285668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e040c493-b416-4c7f-9c27-d7b2aa677d40 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152979 Oct 19 22:23:19.286239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1544/3096] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:19.869018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:19.869622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:19.876150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.876631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.877062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.877743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.878195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.878622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.938814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:19.947833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e58a727-9540-4a57-9dea-3e8a7e9d04f2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083261 Oct 19 22:23:19.948390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1553/3097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:19.982128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:19.982734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:19.988720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.989189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.989613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:19.990283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:19.990726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:19.991173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.116933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:20.125092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f611cdf5-5f69-4efc-b1c0-ea89b49f01df tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146871 Oct 19 22:23:20.125667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1545/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:19 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:20.157171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:20.157781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:20.164198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.164677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.165112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.165794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.166252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.166676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.239144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:20.239756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:20.245747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.246232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.246670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.247389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.247840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.248260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.294633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:20.303154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:20.304578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:20.305720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ae68f764-7070-458c-82ea-f5c59184e6c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152504 Oct 19 22:23:20.306281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1554/3099] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:20.319214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:20.319214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:20.319214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.319214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.319648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.319847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.320577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.321001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.383170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:20.391229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ad1daea-f668-4a58-a7c9-b0cce932d32a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155904 Oct 19 22:23:20.391796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1546/3100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:20.450714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:20.458870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2fd8d9e6-7a1b-4edb-bf67-2a161bab1bb1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151035 Oct 19 22:23:20.459464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1555/3101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:20.970690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:20.971322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:20.977706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.978183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.978612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:20.979308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:20.979754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:20.980169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.041137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:21.049199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f7248c5e-5b92-4aa7-ad66-f4be443499a0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082379 Oct 19 22:23:21.049763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1547/3102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:21.148964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:21.149590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:21.155962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.156438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.156867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.157540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.157987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.158430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.283825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:21.292724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a637390a-e7bc-4405-9d9e-d24854cdc68b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148095 Oct 19 22:23:21.293227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1556/3103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:21 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:21.332243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:21.332845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:21.339191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.339666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.340097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.340766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.341212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.341629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.414374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:21.414992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:21.421051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.421532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.421959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.422641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.423119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.423535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.466600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:21.476030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:21.477820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:21.479049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5cb45b33-a73a-4fba-85ca-7db8c81ee8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150547 Oct 19 22:23:21.479923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1548/3104] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:21.492275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:21.492499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:21.498497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.499001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.499436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.500249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:21.500556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:21.500975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:21.555121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:21.563236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0ebfdfc7-30d1-4b0a-845a-aa7691248714 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153346 Oct 19 22:23:21.563805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1557/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:21.665551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:21.673993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f79c73d8-0119-4448-9001-1063cd5509f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.185766 Oct 19 22:23:21.674566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1549/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:22.073319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:22.073882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:22.079750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.080236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.080668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.081353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.081806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.082222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.146358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:22.154535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ea63d777-d0d4-47eb-ad56-cfdb6bf9fc35 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085951 Oct 19 22:23:22.155190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1558/3107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:22.319227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:22.319829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:22.326536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.326980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.327431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.328113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.328566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.328989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.454179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:22.462281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-360cc9f7-9569-4a35-8c1e-bb9f66cf12e2 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146971 Oct 19 22:23:22.462844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1550/3108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:22 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:22.503815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:22.504422 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:22.510733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.511313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.511755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.512463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.512921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.513627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.586800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:22.587352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:22.593335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.593814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.594251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.594936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.595478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.595907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.639974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:22.648922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:22.650340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:22.651525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2dd77fd0-e933-4ce6-9449-ce4c86c720c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151597 Oct 19 22:23:22.652312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1559/3109] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:22.696446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:22.697055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:22.702889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.703412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.703851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.704546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:22.705004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:22.705431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:22.709880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:22.728758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:22.737206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4ea9c039-28c5-48c8-a0a2-77b9ea79d5cd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154311 Oct 19 22:23:22.737769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1551/3110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:22.831860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:22.840564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-678b7343-4031-4eed-9dc2-d97c64242ccd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148135 Oct 19 22:23:22.841066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1560/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:23.176754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:23.177288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:23.183397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.183878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.184317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.185002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.185454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.185878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.247552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:23.255559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6d09460b-2cd2-4e07-a202-4b9a6ed6ffdb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082819 Oct 19 22:23:23.256637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1552/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:23.484687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:23.485296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:23.491881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.492356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.492791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.493473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.493921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.494338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.625235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:23.633871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d19c0649-3d51-4898-a94b-2bc29da99eeb tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.153089 Oct 19 22:23:23.634436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1561/3113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:23 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:23.676822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:23.677427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:23.684343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.684815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.685245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.685919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.686363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.686780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.760904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:23.761429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:23.767325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.767808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.768241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.768924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.769377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.769803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.815895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:23.824668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:23.826106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:23.827303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cea85a9e-b5a2-4924-a9b4-a5396c3a5934 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154299 Oct 19 22:23:23.827865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1553/3114] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:23.864145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:23.864756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:23.871186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.871668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.872102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.872789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:23.873239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:23.873659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:23.897997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:23.906200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b9e2dfb7-86d8-4f8e-895b-277764b8989b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149197 Oct 19 22:23:23.906771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1562/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:24.001610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:24.009695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b784185e-da5c-4a72-ad78-56e628a48797 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149294 Oct 19 22:23:24.010257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1554/3116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:24.278731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:24.279448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:24.285491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.285975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.286410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.287768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.288231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.288658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.348324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:24.357134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cde21eea-f686-4ceb-b579-02642d39965e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082377 Oct 19 22:23:24.357697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1563/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:24.656112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:24.656688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:24.663148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.663631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.664060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.664758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.665188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.665607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.790877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:24.799037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-03dd4b73-4a3d-460c-a635-8d0d88af161a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146804 Oct 19 22:23:24.799603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1555/3118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:24 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:24.853269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:24.853887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:24.860286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.860769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.861212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.861896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.862354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.862779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.929780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:24.930413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:24.936610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.937103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.937575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.938271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:24.938729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:24.939224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:24.994255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:25.003034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:25.004481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:25.005650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8b5de3b2-4d57-4848-9922-4e5f950de28c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156775 Oct 19 22:23:25.006219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1564/3119] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:25.033009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:25.033774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:25.041072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:25.041579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:25.042018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:25.042721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:25.043209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:25.043640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:25.071715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:25.080002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4ca1e88b-bd91-42dd-acb3-a27b8eff1016 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154163 Oct 19 22:23:25.080586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1556/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:25.173913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:25.182152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f7c9dc09-ef8b-487f-b0d8-ecd1c381874e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152876 Oct 19 22:23:25.182652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1565/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:25.379324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:25.380054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:25.386637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:25.387164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:25.387600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:25.388283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:25.388732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:25.389154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:25.449919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:25.457970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-475061b5-8313-4b8a-8e4f-1ed369ba0559 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082460 Oct 19 22:23:25.458526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1557/3122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:25.822398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:25.823035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:25.829115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:25.829595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:25.830032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:25.830712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:25.831201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:25.831626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:25.960287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:25.968443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dcc9cf44-65da-44fd-8ee2-e24d3f937e3a tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150732 Oct 19 22:23:25.969005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1566/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:25 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:26.031139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:26.031755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:26.038718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.039184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.039622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.040305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.040754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.041176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.104016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:26.104619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:26.110404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.110881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.111347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.112030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.112478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.112895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.168064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:26.176675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:26.178717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:26.179890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5adc1b10-ed0a-458f-8ab4-b6f69b27f198 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152618 Oct 19 22:23:26.180452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1558/3124] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:26.205130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:26.205734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:26.211493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.211969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.212399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.213074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.213521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.213940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.242946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:26.251370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bd8d0738-0302-4b5f-bcdd-bf411f72c429 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151678 Oct 19 22:23:26.251943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1567/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:26.343826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:26.352383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8eb4b90a-ba8b-48a9-b3c1-ddd85dbb363b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150969 Oct 19 22:23:26.352951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1559/3126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:26.481628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:26.482233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:26.488398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.488885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.489324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.490016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.490473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.490900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:26.550397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:26.558466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5def1217-7ca3-4d65-b0f3-18aef7b2dbde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.080671 Oct 19 22:23:26.559043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1568/3127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:26.991819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:26.992432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:26.998493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:26.998991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:26.999458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.000138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.000592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.001015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.016911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:27.127912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:27.136720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-55db7bb2-be9a-4174-93f1-dcbb9a15b356 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149369 Oct 19 22:23:27.137282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1560/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:26 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:27.205452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:27.206115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:27.213114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.213594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.214033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.214711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.215186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.215610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.275320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:27.275840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:27.281628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.282104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.282533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.283229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.283679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.284093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.348492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:27.358240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:27.359707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:27.360856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e244a5dc-dd48-4945-aa0f-a2753b3162a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.159371 Oct 19 22:23:27.361408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1569/3129] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:27.379734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:27.380336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:27.386305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.386783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.387260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.387953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.388397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.388810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.419896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:27.428329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c61ca094-e806-44c6-80c4-c918c04a6fd6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.157354 Oct 19 22:23:27.428905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1561/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:27.518123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:27.526357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8294d600-adc5-4f56-94b3-61f1e8e8be3f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150141 Oct 19 22:23:27.526865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1570/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:27.580934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:27.581543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:27.587399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.587875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.588306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.588987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:27.589437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:27.589861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:27.649141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:27.657162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3d61aad8-71ad-49b9-854b-b79b8e15ab0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.080053 Oct 19 22:23:27.657720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1562/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:28.159855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:28.160475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:28.167116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.167591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.168023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.168699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.169145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.169559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.299281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:28.307455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-39525ab8-f8a6-4550-8eae-298d1dbbaa03 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151942 Oct 19 22:23:28.308048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1571/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:28 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:28.386063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:28.386603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:28.392946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.393429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.393860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.394575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.395054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.395478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.450932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:28.456902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:28.457396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.457881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.458326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.459677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.460136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.460559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.528807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:28.537617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:28.539106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:28.540278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5852548b-3e87-4dad-b7e6-5c6f792db7a0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158151 Oct 19 22:23:28.540843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1563/3134] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:28.549282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:28.550128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:28.556149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.556628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.557102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.557744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.558186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.558597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.591407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:28.599730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3268eaaa-3ec0-47a9-bf2f-a34d59d0164b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152616 Oct 19 22:23:28.600304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1572/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:28.680702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:28.681309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:28.687292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.687777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.688214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.688905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:28.689359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:28.689783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:28.690036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:28.699440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4e251996-b143-477e-a2be-fcdf27836db6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153725 Oct 19 22:23:28.700022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1564/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:28.751295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:28.759882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4715a005-36fe-4fca-926b-98284ec9cd77 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083540 Oct 19 22:23:28.760433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1573/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:29.331010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:29.331529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:29.340183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.340667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.341097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.341781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.342262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.342676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.470459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:29.479167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-77426502-fbe9-4f17-8789-30b257112157 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152081 Oct 19 22:23:29.479719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1565/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:29 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:29.565745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:29.566353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:29.573208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.573686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.574118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.574806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.575282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.575705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.621682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:29.622206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:29.628015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.628491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.628922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.629601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.630045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.630478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.706289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:29.715534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:29.716975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:29.718151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3b08caf-993c-4c9f-b15f-f55a8b10efd2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156335 Oct 19 22:23:29.718716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1574/3139] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:29.723127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:29.723733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:29.730488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.731090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.731434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.732123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.732576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.732997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.762906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:29.771003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2a748c4-47cc-40d4-af3d-d9447eac2e90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153232 Oct 19 22:23:29.772527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1566/3140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:29.781441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:29.782056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:29.788213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.788709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.789217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.789926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:29.790385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:29.790813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:29.854136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:29.862398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ad543f02-808d-4ce2-b753-586f2ec9cadf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084672 Oct 19 22:23:29.862981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1567/3141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:29.863712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:29.872234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bcf04036-2306-4e2e-8d61-4309dd9db77e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152458 Oct 19 22:23:29.872732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1575/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:30.501584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:30.502205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:30.509336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.509817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.510252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.510939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.511417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.511841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.638819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:30.649529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dfb53a1d-0485-4de9-8b72-d047bfa886aa tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.151742 Oct 19 22:23:30.650434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1568/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:30 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:30.743796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:30.744542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:30.751019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.751505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.751990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.752628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.753082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.753515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.794904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:30.795666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:30.801976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.802741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.803221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.803922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.804381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.804808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.884025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:30.886482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:30.893799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:30.895282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:30.897226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a8bbc0aa-8c7c-4d47-af94-d4dac894c90c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156502 Oct 19 22:23:30.899093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1576/3144] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:30.915287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:30.915287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:30.915287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.915287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.915742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.915742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.915742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.915742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.937404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:30.946546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2ecfa9da-c3ee-4062-8d9e-028df8f74ab1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155457 Oct 19 22:23:30.947140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1569/3145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:30.951654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:30.952260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:30.957914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.958460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.958915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.959628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:30.960080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:30.960497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:30.973002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:30.981161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d30132fc-2c5d-45d2-b8d7-9f7ab320770e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082428 Oct 19 22:23:30.981736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1577/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:31.089820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:31.098040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8cf4e716-a558-4e45-a0ae-f59ed5ad1d1d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149951 Oct 19 22:23:31.098597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1570/3147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:31.672287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:31.672901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:31.678835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:31.679374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:31.679816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:31.680502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:31.680957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:31.681402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:31.807183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:31.815506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-224d935c-f9bc-4f27-843a-df356f2e74d0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147088 Oct 19 22:23:31.816070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1578/3148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:31 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:31.927621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:31.928239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:31.934613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:31.935142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:31.935582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:31.936295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:31.936752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:31.937519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:31.969123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:31.969767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:31.976410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:31.977092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:31.977537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:31.978233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:31.978687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:31.979141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:32.065367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:32.075044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:32.076626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:32.077898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b83daff3-95d7-45e1-ad9c-9d8644b83840 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154120 Oct 19 22:23:32.078549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1571/3149] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:32.082986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:32.083668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:32.090298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:32.090785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:32.091333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:32.092025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:32.092984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:32.092984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:32.112638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:32.121425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ecc2049d-5921-43f3-9196-66bcdcdb99d1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.156117 Oct 19 22:23:32.122005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1579/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:32.126453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:32.127098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:32.133673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:32.135021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:32.135021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:32.135374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:32.135916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:32.136358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:32.159612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:32.168087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-751f93e7-35dc-4a57-beee-af206c82701f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088385 Oct 19 22:23:32.168656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1572/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:32.267353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:32.276274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-275ea64e-607a-487d-8e94-43a0d1238443 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153323 Oct 19 22:23:32.276846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1580/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:32.838971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:32.839597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:32.845478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:32.845960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:32.846393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:32.847096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:32.847549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:32.847968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:32.975022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:32.983123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5c39b9d1-3c76-4244-85eb-e41c2f4aa290 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.147970 Oct 19 22:23:32.983685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1573/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:32 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:33.104380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:33.104924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:33.111391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.111867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.112302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.112991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.113443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.113864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.144279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:33.144982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:33.151543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.152097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.152533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.153221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.153867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.154293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.245428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:33.254010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:33.255477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:33.256674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-25b1e491-814f-46cb-9435-a25cba34ec91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156235 Oct 19 22:23:33.257225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1581/3154] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:33.261569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:33.262172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:33.267898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.268373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.268922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.269614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.270070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.270492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.286925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:33.295796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-187a918b-ef40-483d-b712-b07fe98fca8e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155342 Oct 19 22:23:33.296369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1574/3155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:33.300867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:33.301469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:33.307375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.307861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.308297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.308982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:33.309435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:33.309858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:33.335825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:33.344091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0e0d460a-ec58-461d-b838-f5260c956b75 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085909 Oct 19 22:23:33.344663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1582/3156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:33.441485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:33.449852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-efa50707-f8dc-4e87-b71c-0dbf5dfc5bff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152548 Oct 19 22:23:33.450414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1575/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:34.007326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:34.008056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:34.014041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.014519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.014962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.015663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.016109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.016528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.141052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:34.149126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d5d03ff3-7910-409a-b954-0f9576eb5628 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146673 Oct 19 22:23:34.149680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1583/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:34 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:34.283265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:34.283886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:34.286245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:34.291426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.291908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.292379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.293067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.293528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.293954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.318832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:34.319463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:34.325462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.325947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.326408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.327124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.327568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.327986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.423779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:34.433004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:34.434429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:34.435614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7ebdc487-e612-4b5f-a895-f41666458a70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156294 Oct 19 22:23:34.436172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1576/3159] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:34.440782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:34.441380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:34.447282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.447765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.448192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.448876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.449324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.450161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.453734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:34.461094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:34.469449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-101f7ceb-f7b8-4bef-aa23-6119be13a769 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154478 Oct 19 22:23:34.470020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1584/3160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:34.475042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:34.475646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:34.481268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.481789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.482227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.482908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:34.483379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:34.483804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:34.527604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:34.536244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-40dd0d14-cc25-42ce-aba9-1e38ff15cc3b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.099087 Oct 19 22:23:34.536896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1577/3161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:34.611157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:34.619839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-500f9dc7-4544-40fc-9bac-b20adafeb43e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148807 Oct 19 22:23:34.620405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1585/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:35.171621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:35.172159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:35.178741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.179240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.179861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.183092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.183579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.185172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.312215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:35.320328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-06be509d-ccc8-42e7-9707-ab916eba99a4 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152604 Oct 19 22:23:35.321155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1578/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:35 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:35.461115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:35.461725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:35.468271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.472906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.472906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.472906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.472906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.473359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.493490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:35.494101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:35.500189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.507154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.507154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.507154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.507154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.507568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.600193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:35.608714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:35.610147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:35.611324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d00dd5d0-15ae-45d5-81de-1d5275c0d1b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154718 Oct 19 22:23:35.611886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1586/3164] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:35.616175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:35.616773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:35.619383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:35.622586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.623099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.623535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.624261 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.624672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.625087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.632583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:35.640581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ab47267-a868-4d5a-92da-1aaa022130f6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150957 Oct 19 22:23:35.641172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1579/3165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:35.645587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:35.646185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:35.660799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.661284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.661715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.663015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:35.663466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:35.663884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:35.700450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:35.708655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0f08cc69-b3fe-4168-8448-8acc332ac326 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.095813 Oct 19 22:23:35.709780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1587/3166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:35.795672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:35.803790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b7d7067a-e0f5-417c-b11d-f6ab2cfcc246 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.161703 Oct 19 22:23:35.804350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1580/3167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:36.343349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:36.343890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:36.349884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.350368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.350805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.351525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.351978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.352402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.479448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:36.487766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e53cafa3-cfa4-4de0-b87c-f4373cd79c1b tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.148341 Oct 19 22:23:36.488325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1588/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:36 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:36.636723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:36.637296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:36.643745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.644221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.644647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.645326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.645773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.646190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.666314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:36.666916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:36.675586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.676066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.676503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.677187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.677633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.678048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.778226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:36.788452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:36.790013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:36.791289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c1238cf2-8065-4c97-a19e-fb7c528f6843 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158561 Oct 19 22:23:36.792273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1581/3169] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:36.796559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:36.797245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:36.804068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.804646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.805475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.806176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.807242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.807242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.820982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:36.830006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-92d644e7-d60b-4265-b1f8-96f8d125bba6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.168047 Oct 19 22:23:36.830650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1589/3170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:36.835286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:36.835886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:36.841981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.842457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.842986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.843660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:36.844102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:36.844524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:36.872506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:36.880751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b06385a-ee33-4ab6-a78e-fed2f831c029 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087648 Oct 19 22:23:36.881318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1582/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:36.995232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:37.003399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3b4aac4-85bd-4386-be83-e0ad975bf76b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.171736 Oct 19 22:23:37.003963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1590/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:37.511839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:37.512443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:37.518354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.518828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.519291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.519967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.520411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.520828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.649030 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:37.657063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3453a513-69cc-4596-bbf4-eae665d38aa0 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149109 Oct 19 22:23:37.657627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1583/3173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:37 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:37.821691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:37.822393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:37.828863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.829343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.829780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.830462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.830912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.831360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.853591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:37.854133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:37.860253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.860743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.861185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.861888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.862342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.862773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.965498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:37.971262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:37.972709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:37.974162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2232d581-c5aa-413a-8a99-428da39df694 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157548 Oct 19 22:23:37.974731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1591/3174] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:37.979248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:37.979855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:37.985578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.986067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.986500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.987496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:37.988142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:37.988578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:37.994352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:38.002597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91445bca-a3c8-4151-abb7-b5ef4906185f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152976 Oct 19 22:23:38.003196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1584/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:38.026442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:38.027092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:38.033158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:38.033647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:38.034085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:38.034783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:38.035265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:38.035689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:38.051621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:38.061153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8f19a30a-5662-45b9-abfe-36cdace5a7f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085388 Oct 19 22:23:38.061732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1592/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:38.211771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:38.219793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-95305db6-646e-4128-8e4a-b674dfed27fd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.197114 Oct 19 22:23:38.220348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1585/3177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:38.743810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:38.744425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:38.750445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:38.750929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:38.751404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:38.752090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:38.752571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:38.752996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:38.767977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:38.881120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:38.889607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-217e8d44-ce91-4c19-95cf-a455e00168c8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.213637 Oct 19 22:23:38.890156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1593/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:38 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:39.000088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:39.000624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:39.007618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.008093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.008518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.009193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.009640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.010056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.027288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:39.027931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:39.033822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.034311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.034748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.035477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.036081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.036510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.139639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:39.148497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:39.149971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:39.151281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f8a1c23d-29c4-4d27-8810-5b1173d519a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155041 Oct 19 22:23:39.151840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1586/3179] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:39.163153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:39.163153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:39.163153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.163153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.163735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.163842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:39.164160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.164616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.165041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.172983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6d4bd7ad-e290-4e6f-a67e-edcac6b89019 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149515 Oct 19 22:23:39.173557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1594/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:39.231558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:39.239556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-83472073-77aa-4a1e-9df5-684169644211 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086787 Oct 19 22:23:39.240116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1587/3181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:39.243826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:39.244441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:39.250281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.250703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.251172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.251855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.252447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.252872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.382509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:39.390653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d15b1e53-4de8-4272-a18f-e20db98fb784 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151343 Oct 19 22:23:39.391253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1595/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:39.913467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:39.914072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:39.920060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.920540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.920974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:39.921656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:39.922108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:39.922557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.053920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:40.061942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5e3c1b29-e227-4bdb-8d13-e54ddb1a0600 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152898 Oct 19 22:23:40.062507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1588/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:39 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:40.177836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:40.178449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:40.184877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.185391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.185827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.186516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.186992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.187417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.201391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:40.202202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:40.208085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.208570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.209000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.210229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.210679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.211143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.317137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:40.326700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:40.328339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:40.329574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-aa7ef34c-d791-4e0c-96f2-2bcf116f3dee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155743 Oct 19 22:23:40.330200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1596/3184] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:40.335397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:40.336119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:40.342091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:40.342266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.342771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.343316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.344082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.344614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.345108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.351100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-83e1c25e-9a6d-4ff4-bc92-e9964b20580a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153565 Oct 19 22:23:40.351666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1589/3185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:40.406247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:40.413612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:40.414217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:40.414690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3659adeb-daca-459a-a5c7-22f80361c6da tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083441 Oct 19 22:23:40.415288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1597/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:40.420285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.420765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.421222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.421907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:40.422351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:40.422768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:40.552034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:40.560210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9dbd70c5-7746-42e2-8fad-723bc16e7218 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150529 Oct 19 22:23:40.560777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1590/3187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:41.084814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:41.085350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:41.091311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.091790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.092225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.092902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.093352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.093767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.228993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:41.233054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7e7e5337-8cad-41dc-9b59-371117846df7 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.152294 Oct 19 22:23:41.233609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1598/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:41 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:41.356025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:41.356560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:41.363937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.363937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.364225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.364831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.365279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.366294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.373785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:41.374388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:41.380262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.380740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.381179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.381918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.382366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.382870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.503083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:41.509367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:41.512129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:41.513615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:41.514789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-44a7b159-e777-4b57-a0fe-bfef7a068125 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162795 Oct 19 22:23:41.515438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1591/3189] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:41.517568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62312536-fb99-4967-bab5-c05c99393e41 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147667 Oct 19 22:23:41.518254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1599/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:41.520160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:41.520773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:41.527175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.527666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.528108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.528798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.529256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.529682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.583283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:41.583929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:41.590418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:41.590579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.590920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.591508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.592205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:41.592657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:41.593081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:41.598536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-98bd893e-72d3-44dc-9f3b-bd876e139e44 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082010 Oct 19 22:23:41.599126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1592/3191] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:41.721485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:41.730183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b29f7909-84a8-4b2b-814d-cdbc2637b359 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150733 Oct 19 22:23:41.730733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1600/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:42.256198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:42.256844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:42.262771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.263295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.263730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.264423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.264876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.265302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.393679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:42.395865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:42.403050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-897ed66b-8e00-4cf1-8e05-194d97bfbc49 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150757 Oct 19 22:23:42.403608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1593/3193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:42 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:42.540589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:42.541171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:42.541301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:42.541790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:42.547760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.547920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.548248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.548376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.548682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.548797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.549457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.549910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.550338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.552161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.552621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.553048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.683050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:42.687471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:42.694456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3449c425-edd6-4cd0-8119-bf63b1c90038 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154319 Oct 19 22:23:42.694456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1594/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:42.696894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:42.697151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:42.697748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:42.698328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:42.699595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-365e28ac-71ab-42a9-87bf-899bb8681dc2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162969 Oct 19 22:23:42.704114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.704588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.705016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.705773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.706242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.706661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.707299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1601/3195] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:42.753159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:42.753891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:42.760508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.761069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.761576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.762330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:42.762862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:42.763323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:42.767818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:42.776522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4fd9ad5b-3bc2-4061-a04e-0d510e363ff4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083710 Oct 19 22:23:42.777265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1595/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:42.895354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:42.904326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-74e7b375-e4e7-43da-b8c3-b49133d69114 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.155099 Oct 19 22:23:42.905280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1602/3197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:43.427267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:43.427859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:43.435124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.435619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.436046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.436717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.437158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.437571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.565195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:43.573872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9f6e611b-17ad-4cb7-bd03-f01a9f210b99 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.150625 Oct 19 22:23:43.574448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1596/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:43 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:43.716670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:43.717277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:43.723774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.724256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.724686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.725162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:43.726002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.726387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:43.726511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.726857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.732134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.732608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.733034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.733709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.734155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.734574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.862099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:43.870482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5e687a10-b42b-4ce5-ba60-ea3c57e2f39f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.157625 Oct 19 22:23:43.871084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1603/3199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:43.875603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:43.876218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:43.881895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.882371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.882803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.883493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.883941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.884356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.889241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:43.897684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:43.898490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:43.899675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-175a0b16-288b-449f-9ef4-a1cee642a7ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.178383 Oct 19 22:23:43.900455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1597/3200] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:43.927391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:43.928078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:43.934058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.934540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.934993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.935707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:43.936135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:43.936555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:43.947960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:43.956150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7c1687c8-3fa4-4683-a9f9-7bbc889882f6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084143 Oct 19 22:23:43.956711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1604/3201] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:44.070050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:44.078338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c43bfc2d-13e6-4907-bb9d-3d2b656365ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154683 Oct 19 22:23:44.078898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1598/3202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:43 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:44.596991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:44.597608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:44.603649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:44.604132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:44.604568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:44.605249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:44.605706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:44.606126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:44.733937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:44.742501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-da4a2a06-8967-4c59-b7a7-97f7d5be16e8 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149465 Oct 19 22:23:44.743070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1605/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:44 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:44.893529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:44.894070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:44.900487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:44.900962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:44.901389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:44.902060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:44.902505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:44.902922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:44.925140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:44.925744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:44.932699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:44.933262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:44.933769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:44.934538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:44.935120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:44.935641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:45.030562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:45.039381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-97a6022d-4aba-4cb5-9d20-016fcec0e0c9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149642 Oct 19 22:23:45.045708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1599/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:45.045708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:45.045708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:45.050790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:45.051313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:45.051780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:45.052450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:45.052902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:45.053888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:45.066084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:45.075335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:45.076764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:45.077912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-844be098-d3e8-4c0e-b42a-178aa4fb3d91 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156619 Oct 19 22:23:45.078571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1606/3205] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:45.101922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:45.102657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:45.108585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:45.109129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:45.109628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:45.110402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:45.110917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:45.111423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:45.116649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:45.124636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-96e82fa4-d8e7-4599-8fa3-ede8082780c1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083717 Oct 19 22:23:45.125200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1600/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:45.240779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:45.248893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e3b461fb-66bf-4d1e-bb91-bf26fbedf7bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151253 Oct 19 22:23:45.249453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1607/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:45.766034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:45.766646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:45.773398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:45.773906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:45.774340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:45.775046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:45.775498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:45.775919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:45.903885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:45.911866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-78b8f243-b5ce-4868-bf8b-f46682667c61 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.149692 Oct 19 22:23:45.912430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1601/3208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:45 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:46.062960 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:46.063599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:46.069997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.070482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.071210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.071904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.072357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.072782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.103830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:46.104524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:46.110439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.110925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.111397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.112082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.112538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.112961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.204294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:46.213053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-baad94b2-b2ea-44cf-92d9-3399e52383e3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154002 Oct 19 22:23:46.213626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1608/3209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:46.251011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:46.260123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:46.261563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:46.262715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b641f66-c970-4a8d-9084-b3f59e595fbb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.163359 Oct 19 22:23:46.263295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1602/3210] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:46.266432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:46.267129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:46.273760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.275985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.275985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.275985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.275985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.276433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.278546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:46.279406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:46.285503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.285932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.286363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.287089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.287570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.288011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.340034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:46.348939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d89d67e-da6b-4d26-ac4e-2330a1a75d92 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.134295 Oct 19 22:23:46.349522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1609/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:46.419101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:46.427263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-95bbb4e2-3dbb-423f-aa03-853800d09edf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153001 Oct 19 22:23:46.427830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1603/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:46.935123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:46.935719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] [instance: c3772e1d-c468-46b9-95cf-d21bb0e427b6] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:46.941643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.942123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.942559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.943282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:46.943737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:46.944767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:46.947564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:47.069679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea5afc217f843389fe051b42616e09d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec4ff60137544109a46d3a5810251f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:47.078059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-51dc99b7-2d72-4971-9e9b-a35945a55567 tempest-VolumesSnapshotTestJSON-1273423284 tempest-VolumesSnapshotTestJSON-1273423284-project] 10.222.0.20 "GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6" status: 200 len: 1559 microversion: 2.1 time: 0.146911 Oct 19 22:23:47.078631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1610/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:46 2022] GET /compute/v2.1/servers/c3772e1d-c468-46b9-95cf-d21bb0e427b6 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:47.236005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:47.236695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:47.243213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.243703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.244146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.244834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.245315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.245946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.288186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:47.288965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:47.295024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.295517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.295958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.296656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.297112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.297536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.379146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:47.388387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1e706feb-5231-44c0-adeb-aae0ace56b49 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.156182 Oct 19 22:23:47.389119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1604/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:47.397248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:47.398382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:47.404877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.407026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.407026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.407026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.407026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.407429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.438205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:47.448134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:47.449707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:47.450973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1eb6162d-9197-4d13-9e30-0d5f9a6947ae tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.166663 Oct 19 22:23:47.451635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1611/3215] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:47.460335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:47.461075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:47.467177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.467734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.468238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.470826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:47.471395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:47.471508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:47.471979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:47.479444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f0a0f3f7-a197-4cf7-ac8a-d96ce10630e7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089032 Oct 19 22:23:47.480011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1605/3216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:47.597373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:47.605544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4e54427a-55fa-4086-bd42-69a78e97f25f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148849 Oct 19 22:23:47.606110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1612/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:48.413787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:48.414339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:48.420714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.421194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.421629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.422312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.422760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.423213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.477494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:48.478363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:48.484814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.485288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.485713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.486395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.486840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.487366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.556003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:48.564172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09d940da-1475-4cb7-99ed-011cc5bbbee6 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154939 Oct 19 22:23:48.564742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1606/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:48.569694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:48.570291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:48.576749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.577233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.577668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.578359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.578816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.579259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.622348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:48.631076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:48.634067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:48.635264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-058ab4e1-f583-4b49-b36b-9e39f6c63ed9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162526 Oct 19 22:23:48.635821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1613/3219] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:48.640267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:48.640861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:48.646444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:48.650676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.651218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.651650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.652341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:48.652789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:48.653205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:48.655367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ffbfc06-fdcc-4c9d-84ab-b2f39748da47 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089662 Oct 19 22:23:48.655931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1607/3220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:48.780075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:48.789187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4e8983fe-8179-4020-90fe-cdf6161904f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152229 Oct 19 22:23:48.789754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1614/3221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:49.587756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:49.588357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:49.594762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.595275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.595706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.596392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.596837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.597255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.661595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:49.662164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:49.668784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.669263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.669690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.670372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.670822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.671276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.731962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:49.732586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dc754cbe-6e98-4b9a-8c52-eaa20ce2e2b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148568 Oct 19 22:23:49.733162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1608/3222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:49.737806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:49.738405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:49.744329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.744806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.745242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.745937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.746385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.746809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.811057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:49.812018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:49.819719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:49.820146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f67f25da-275c-487f-9536-63ea52cc52fd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085845 Oct 19 22:23:49.820715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1609/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:49.821406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:49.822560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dcada40c-67c2-42f5-bc07-d7e8239e7e5c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.164876 Oct 19 22:23:49.827099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1615/3224] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:49.827263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:49.827263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:49.831865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.832346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.832786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.833470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:49.833920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:49.834868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:49.849632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:49.958599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:49.967468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f339fd8-c194-4289-b6b6-60a7c64898e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145547 Oct 19 22:23:49.968038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1610/3225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:50.762813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:50.763479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:50.769795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.770267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.770698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:50.771405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.772482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.772915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:50.843551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:50.844143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:50.850062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.850545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.850988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:50.851675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.852122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.852541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:50.899124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:50.907400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fb501247-d1d3-4cbf-aa4f-8870d436c77d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148398 Oct 19 22:23:50.907969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1616/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:50.912644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:50.913250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:50.914333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:50.918930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.919551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.919988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:50.920675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.921127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.921548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:50.923406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3b3c3227-831d-458b-807f-cb05eb4ddff6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083776 Oct 19 22:23:50.924053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1611/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:50.991040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:50.991646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:50.997376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.997853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.998279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:50.998972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:50.999428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:50.999846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:51.047800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:51.056423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:51.057892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:51.059103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4a411e8-408e-4e77-8d9b-8de53119a656 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150139 Oct 19 22:23:51.059658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1617/3228] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:51.129591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:51.138520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-daaa3e11-46d3-4b32-a0eb-329c8c47ea1b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151441 Oct 19 22:23:51.139112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1612/3229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:51.930339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:51.930964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:51.937620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:51.938100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:51.938532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:51.939240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:51.939690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:51.940108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:51.945525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:51.946451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:51.952783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:51.953260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:51.953688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:51.954368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:51.954814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:51.955262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:52.016760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:52.025773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c7ba8fb9-be98-416b-8af3-f473df1b8362 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083956 Oct 19 22:23:52.026465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1613/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:52.085249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:52.085859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:52.092132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:52.092627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:52.093062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:52.093770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:52.094223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:52.094645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:52.228434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:52.237223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:52.238745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:52.239927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-448c2565-6809-4eb9-a09b-2fa84f1a708c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.159230 Oct 19 22:23:52.240726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1614/3231] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:23:52.263560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:52.265896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:52.269934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:52.270496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:52.270921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:52.271623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:52.272638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:52.273060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:52.288078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:52.298997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76a1068a-d2c2-490c-b540-ec2ba1b9841e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.369888 Oct 19 22:23:52.298997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1618/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:52.405419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:52.413521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dedc707c-6548-4bc3-8841-11293bb36435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154047 Oct 19 22:23:52.414085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1615/3233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:53.050026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:53.050570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:53.057655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.058140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.058581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.059305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.059761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.060284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.120585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:53.128648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d28d28a4-b506-49a0-92e3-baf48eb2ebba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082604 Oct 19 22:23:53.129209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1619/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:53.265626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:53.266213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:53.273271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.273746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.274173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.274848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.275319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.275737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.320136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:53.320657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:53.326699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.327476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.327915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.328599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.329046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.329462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.403506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:53.412428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:53.414016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:53.415612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e6e4334-dbfe-4ef4-9eb5-290e1b44564c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153321 Oct 19 22:23:53.415970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1616/3235] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:53.436849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:53.437486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:53.443147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.443621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.444657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.445339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:53.445783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:53.446451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:53.462312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:53.470401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dc8cd462-e5a2-4e81-af7c-ecad69267c3a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154706 Oct 19 22:23:53.470980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1620/3236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:53.572657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:53.580756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-692ffb31-a4d7-4b6e-972e-6feb42716540 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147676 Oct 19 22:23:53.581325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1617/3237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:54.151269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:54.151875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:54.158496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.158998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.159436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.160132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.160614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.161038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.225245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:54.233330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2c470d60-fcf4-4f67-945f-9fb62a0a955a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086030 Oct 19 22:23:54.233886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1621/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:54.441016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:54.441600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:54.448809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.449287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.449720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.450404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.450853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.451411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.493760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:54.494474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:54.500363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.500848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.501289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.501984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.502444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.502867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.579338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:54.588182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:54.589616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:54.590775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d606d6b7-03fb-43e2-8360-2fac81b0199a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153806 Oct 19 22:23:54.591380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1618/3239] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:54.603735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:54.604340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:54.610026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.610502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.610965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.611629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:54.612076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:54.612499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:54.629895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:54.638084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-38289116-e4c8-4890-a0c4-d0c66d13d20f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148618 Oct 19 22:23:54.638803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1622/3240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:54.738126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:54.747241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-873b5460-58c7-4ca3-96a4-61aff3466d5c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147841 Oct 19 22:23:54.747785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1619/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:55.256807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:55.257419 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:55.263913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.264403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.264855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.265555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.266011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.266439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.328285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:55.336349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e46a983-e60d-40a9-a2f1-33191bf9232e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083937 Oct 19 22:23:55.336904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1623/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:55.617122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:55.617679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:55.624066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.624543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.624975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.625647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.626091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.626505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.660308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:55.660921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:55.667901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.668391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.668826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.669523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.669977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.670401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.763702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:55.772995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:55.774434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:55.775626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-67927e16-2e57-4d26-8a61-f725762a6d28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.163076 Oct 19 22:23:55.776606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1620/3243] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:55.780504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:55.781579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:55.787493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.794486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.794486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.794486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:55.794486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:55.795535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:55.809749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:55.817918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-72b8bb29-f0b7-4b02-a317-7df6665f0bb0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.161423 Oct 19 22:23:55.818485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1624/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:55.918361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:55.926472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-18edacf5-990d-4e93-8e85-c98473a92277 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149369 Oct 19 22:23:55.927047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1621/3245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:56.359852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:56.360462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:56.367703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.368188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.368627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.369345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.369801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.370226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.430103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:56.438146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0b596f63-3fb3-4b29-9c6c-a0c6e4ecc1ba tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082228 Oct 19 22:23:56.438703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1625/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:56.801503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:56.802110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:56.808593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.809073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.809506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.810187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.810639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.811089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.840658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:56.841259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:56.848764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.849257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.849693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.850385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.850841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.851296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.940852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:56.950393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:56.951868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:56.953027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-574d567e-b0b4-4230-a56a-d17bdfbaafc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155359 Oct 19 22:23:56.953585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1622/3247] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:56.957947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:56.958555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:56.964960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.965443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.965970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.966671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:56.967144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:56.967577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:56.977815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:56.979996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:56.986448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a6ef95ff-af0e-4d0b-b945-5134e7442317 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149559 Oct 19 22:23:56.987025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1626/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:57.095903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:57.104452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dbec41f2-7428-4f94-861b-f03df6394885 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149941 Oct 19 22:23:57.105014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1623/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:57.461406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:57.462016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:57.468901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:57.469382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:57.469815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:57.470496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:57.470983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:57.471412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:57.534035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:57.542140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2ce47fe2-a89b-4d62-8e95-eb11ebeef222 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085139 Oct 19 22:23:57.542764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1627/3250] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:57.979355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:57.979961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:57.986321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:57.986797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:57.987262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:57.987938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:57.988381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:57.988798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:58.010241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:58.010866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:58.016819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:58.017308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:58.017744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:58.018433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:58.018891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:58.019355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:58.119831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:58.128950 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:58.130380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:58.132133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8b9ac270-990f-4e51-adce-0655f1932e2b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156503 Oct 19 22:23:58.132690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1624/3251] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:58.137088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:58.137689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:58.143278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:58.143852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:58.144182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:58.144874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:58.145310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:58.145731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:58.150326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:58.159184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-73b92a39-19cd-4607-862e-03f1570a89b9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153419 Oct 19 22:23:58.159762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1628/3252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:58.274208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:58.282548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3e57a7eb-c7f6-4187-8b62-3284c0d00805 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148879 Oct 19 22:23:58.283138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1625/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:58.565167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:58.565766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:58.572511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:58.572994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:58.573423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:58.574101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:58.574547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:58.574983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:58.635098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:58.643245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-aafb8bcb-50d3-4e59-9522-57a989890055 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081948 Oct 19 22:23:58.643802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1629/3254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:23:59.157743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:59.158292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:59.160628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:59.165354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.165828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.166257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.166934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.167402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.172776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.183389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:59.184024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:59.189894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.190372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.190790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.191514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.191969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.192409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.302662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:59.311851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:59.313297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:59.314462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3d7c655e-0c79-490a-a6f0-8b2e47a17104 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.160815 Oct 19 22:23:59.315044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1626/3255] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:23:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:23:59.319946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:59.320552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:59.327214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:59.329402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.329986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.330421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.331157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.331603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.332020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.336669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:23:59.340294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-38e42464-1f26-42ad-a2c3-ae01d4e7a457 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.160737 Oct 19 22:23:59.347637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1630/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:59.666052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:23:59.666760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:23:59.673531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.674029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.674473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.675210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:23:59.675669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:23:59.676101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:23:59.742918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:59.751777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e4a35a31-ca3c-47bd-8ca4-7ccd4a6b5bb6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089461 Oct 19 22:23:59.752350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1631/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:23:59.818724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:23:59.827137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-84186359-4073-4638-9ac3-60e1f423d3ac tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.511130 Oct 19 22:23:59.827695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1627/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:23:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:00.341131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:00.341670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:00.347530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.348003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.348431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.349102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.349548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.350577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.365345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:00.366137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:00.372630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.373111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.373544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.374229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.374683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.375198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.477481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:00.485926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:00.487410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:00.488560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62805a6c-ba77-4102-9535-3640277928b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151421 Oct 19 22:24:00.489118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1632/3259] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:00.503023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:00.511679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1dbf0fd3-2f2e-446b-a94e-5b16e93fa762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150102 Oct 19 22:24:00.512224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1628/3260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:00.775539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:00.776177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:00.782495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.783000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.783437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.784118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.784568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.784984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.849728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:00.850054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:00.850440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:00.856332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.856809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.857237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.857916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:00.858138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6c16f962-1156-446c-9dfb-edd5a2b040f1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087080 Oct 19 22:24:00.858362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:00.858688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1633/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:00.858815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:00.986521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:00.995062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6c68eed7-8421-4284-abfd-3919af4aab7e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149196 Oct 19 22:24:00.995615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1629/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:01.513857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:01.514396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:01.520355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:01.520837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:01.521274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:01.522544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:01.523016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:01.523442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:01.534875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:01.535528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:01.541827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:01.542310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:01.542752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:01.543470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:01.543926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:01.544354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:01.651403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:01.659797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:01.661225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:01.662378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d29ceb3f-d0d1-4690-899c-dd4fb3452113 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152585 Oct 19 22:24:01.672972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1634/3263] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:01.673340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:01.679092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-540ca6e9-310b-4090-9e61-ef27b1b20f40 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147975 Oct 19 22:24:01.679647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1630/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:01.881244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:01.881849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:01.888217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:01.888694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:01.889125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:01.889802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:01.890251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:01.890668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:01.951384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:01.960018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1bbf98fb-ceb9-4d7f-92f1-08151c356635 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082040 Oct 19 22:24:01.960582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1635/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:02.017473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:02.018088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:02.024611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.025100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.025543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:02.026229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.026692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.027153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:02.151395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:02.159534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8f91afef-ec07-492c-a0c3-70c960f6f3a7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145825 Oct 19 22:24:02.160106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1631/3266] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:02.688413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:02.689019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:02.695598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.696324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.696762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:02.697439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.697887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.698301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:02.702384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:02.703018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:02.709384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.709861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.710292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:02.710996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.711452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.711876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:02.831734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:02.840359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:02.840532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:02.841797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:02.842978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-591e917c-6d9f-4625-8489-895484b2183c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158461 Oct 19 22:24:02.843539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1636/3267] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:02 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:02.848907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9519ba18-eebd-45f5-acf4-5ab1b2764a39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150278 Oct 19 22:24:02.849548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1632/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:02.981840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:02.982484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:02.984909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:02.989570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.990057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.991165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:02.991856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:02.992313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:02.992738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:03.052370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:03.061015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e55345be-9bed-46a7-ab6f-e2812fafb511 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083013 Oct 19 22:24:03.061582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1637/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:03.182297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:03.182907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:03.188824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:03.189300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:03.189729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:03.190406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:03.190854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:03.191301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:03.322083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:03.330412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c25e96e1-e4a4-455c-af37-e07b48567b83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151877 Oct 19 22:24:03.331019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1633/3270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:03.869151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:03.869762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:03.872728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:03.873427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:03.875985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:03.876480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:03.876962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:03.877659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:03.878115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:03.878574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:03.879863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:03.880347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:03.880786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:03.882111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:03.882575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:03.883017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:04.008037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:04.011840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:04.016900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:04.018351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:04.019589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c48bef19-768e-474a-bc93-6601db7ec02a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154957 Oct 19 22:24:04.020050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a96d169b-d7ed-4048-bfc1-d15062c8a0fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151189 Oct 19 22:24:04.020213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1638/3271] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:04.020599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1634/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:04.083700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:04.084304 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:04.090105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:04.090578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:04.091040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:04.091713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:04.092161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:04.092582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:04.155275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:04.163359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ebca8781-b54d-45f0-9730-cd67e3b5fca1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083399 Oct 19 22:24:04.163951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1639/3273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:04.355018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:04.355550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:04.361520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:04.361999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:04.362434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:04.363154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:04.363612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:04.364036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:04.487594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:04.496262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6e9ef81f-1249-4991-8867-27762739761a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145206 Oct 19 22:24:04.496820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1635/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:05.042889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:05.043473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:05.044583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:05.045320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:05.049843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.050326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.050753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.051459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.051906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.052297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.052424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.052785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.053229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.053920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.054383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.054811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.181420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:05.185152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:05.189659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-84804374-f07e-4f88-9d42-a6f10461db7b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150728 Oct 19 22:24:05.190226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1640/3275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:05.194474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:05.195139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:05.195762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:05.195963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:05.198293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eba83ce1-725c-4c64-867c-1fb433cdec7a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157575 Oct 19 22:24:05.199061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1636/3276] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:05.201766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.202254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.202686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.203481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.203934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.204354 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.263764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:05.272473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b11721b6-756a-4366-a323-70f3c93920c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.080681 Oct 19 22:24:05.273027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1641/3277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:05.518577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:05.519209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:05.525722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.526195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.526633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.527358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:05.527817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:05.528243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:05.654425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:05.663332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-16241385-e61b-4c35-949b-7ebf17411d44 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148015 Oct 19 22:24:05.663888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1637/3278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:06.213221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:06.213830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:06.220322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.220812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.221237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.221916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.222365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.222780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.224038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:06.224653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:06.231092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.231578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.232016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.232712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.233166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.233592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.354173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:06.359608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:06.363191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f0c388ba-3356-46ae-a865-724ae198319d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153812 Oct 19 22:24:06.363777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1642/3279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:06.368696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:06.369037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:06.369293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:06.370464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:06.371747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-931718c8-100e-4bdd-beb8-6d09b4ff938b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151685 Oct 19 22:24:06.372568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1638/3280] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:06.382251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.389790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.389790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.389790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.389790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.390229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.401476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:06.448286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:06.456266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b8033097-f36c-4863-8901-9ef4c82c3c50 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.091559 Oct 19 22:24:06.456832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1643/3281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:06.686477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:06.687043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:06.692963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.693443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.693872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.694551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:06.695022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:06.695447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:06.822815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:06.830861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a762c04d-8ed3-4b8f-a51b-0b0ef1825356 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148280 Oct 19 22:24:06.831448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1639/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:07.386244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:07.386844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:07.393315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.393800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.394232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.394940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.395413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.395831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.397143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:07.397751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:07.404236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.404715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.405148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.405864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.406338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.406784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.528242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:07.536380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c675450-5d94-44af-8e8a-8cd61efb8762 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153967 Oct 19 22:24:07.536947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1644/3283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:07.538141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:07.542044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:07.542537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:07.547962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:07.548356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.548841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.549273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.549831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:07.549952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.550401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.550813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.551495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-864472e3-1810-492a-9888-d2b25694f0c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158144 Oct 19 22:24:07.552320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1640/3284] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:07.614777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:07.622888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bf576fbe-aed0-4769-8f34-9fce2dafbaf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085010 Oct 19 22:24:07.624017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1645/3285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:07.855020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:07.855632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:07.861759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.862277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.862719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.863459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:07.863918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:07.864348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:07.993316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:08.000496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d0022133-1edd-4a43-a438-4b214999100c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149975 Oct 19 22:24:08.001067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1641/3286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:08.560378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:08.560975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:08.567466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:08.567950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:08.568385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:08.569071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:08.569521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:08.570581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:08.577389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:08.578002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:08.584435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:08.584925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:08.585369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:08.586066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:08.586514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:08.586939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:08.698996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:08.707181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-814e8158-e9f1-4468-8302-4789af17a311 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150562 Oct 19 22:24:08.707827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1646/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:08.712420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:08.713024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:08.716881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:08.718670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:08.719347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:08.719781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:08.720471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:08.720917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:08.721336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:08.726134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:08.728151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:08.729345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f9cf175b-a7f6-4d12-b0eb-55c1d03b6d42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155859 Oct 19 22:24:08.729898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1642/3288] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:08.781809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:08.791179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1f9215b5-d52f-4864-b657-1a04b792dd18 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082302 Oct 19 22:24:08.791833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1647/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:09.024772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:09.025380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:09.031278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.031764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.032180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.032856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.033302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.033718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.158342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:09.160523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:09.167679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6d96a1a3-4244-4b3d-8fe3-2b8042b73a04 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146761 Oct 19 22:24:09.168239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1643/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:09.730574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:09.731341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:09.737691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.738167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.738597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.739305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.739750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.740170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.754609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:09.755243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:09.762086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.762557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.763005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.763687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.764134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.764556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.873944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:09.882140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d59e4001-3c30-4a70-a04b-56f3e7ecc255 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155464 Oct 19 22:24:09.883297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1648/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:09.896425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:09.896951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:09.897091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:09.902895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.903461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.903894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.904579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:09.905026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:09.905448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:09.905838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:09.907312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:09.908474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-599126b4-a0b5-4808-ab4d-9213ee03f0cf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158000 Oct 19 22:24:09.909192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1644/3292] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:09.966382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:09.974371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5d8e1ebc-3b2c-4e20-937d-963e96a15e68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086400 Oct 19 22:24:09.974927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1649/3293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:10.190548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:10.191205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:10.197287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:10.197776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:10.198215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:10.198905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:10.199384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:10.199813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:10.325501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:10.333508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a02072b3-9418-41ad-8650-90e794743667 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146877 Oct 19 22:24:10.334065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1645/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:10.904939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:10.905538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:10.911902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:10.912382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:10.912809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:10.913481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:10.913958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:10.914375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:10.934220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:10.934823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:10.941238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:10.941716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:10.942150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:10.942835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:10.943321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:10.943750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:11.043287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:11.051421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e7484fbc-8f1c-4562-aa97-d15a33470119 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150229 Oct 19 22:24:11.052001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1650/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:11.057147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:11.058274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:11.063741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:11.064237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:11.064681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:11.065379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:11.065838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:11.066270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:11.076391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:11.084922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:11.086414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:11.087613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f091fa6-10b2-4583-85e7-364d21e6ff64 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157299 Oct 19 22:24:11.088168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1646/3296] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:11.130044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:11.138247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d75c19e3-c855-46f1-9563-2563e4264c88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085281 Oct 19 22:24:11.138808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1651/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:11.357801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:11.358335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:11.364285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:11.364767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:11.365199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:11.365877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:11.366327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:11.366787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:11.490490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:11.498653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1371097a-688c-44d5-8aaa-97983b5b3b53 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.144816 Oct 19 22:24:11.499243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1647/3298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:12.076100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:12.076712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:12.083213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.083696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.084131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.084814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.085264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.086337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.113493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:12.114103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:12.121244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.121731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.122159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.122843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.123317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.123737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.218275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:12.226823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7777e680-3760-4fb2-9363-1f5ea1845b4a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154570 Oct 19 22:24:12.227420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1652/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:12.231891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:12.232555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:12.238234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.238724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.239220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.239905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.240361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.240772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.261117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:12.269892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:12.271365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:12.272561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf7e092b-349c-4f31-bf50-e9e9dc26815b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162915 Oct 19 22:24:12.273671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1648/3300] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:12.303848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:12.312009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ca349ca2-3a4e-4d1b-8e86-38015a011e30 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083668 Oct 19 22:24:12.312570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1653/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:12.521259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:12.521893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:12.527783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.528259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.528689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.529362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:12.529807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:12.530226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:12.655264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:12.663545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4296d307-c588-43bd-9eda-8a4d61cb3b31 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146100 Oct 19 22:24:12.664627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1649/3302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:13.250455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:13.251091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:13.258052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.258537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.259002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.259691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.260153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.260576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.298934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:13.299569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:13.306010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.306499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.306999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.307699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.308154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.308580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.395855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:13.404696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7b0317f1-cd96-4098-99b9-f0e20e9290a4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.158080 Oct 19 22:24:13.405266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1654/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:13.409637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:13.410242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:13.416276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.416761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.417200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.417891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.418345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.418769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.437631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:13.447086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:13.448531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:13.449697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f6e2518b-04fc-4fb9-9d21-91365e0b90ec tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154599 Oct 19 22:24:13.450254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1650/3304] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:13.480234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:13.488308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-928399b1-83d2-4d69-93b4-8d29542d525d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082121 Oct 19 22:24:13.488865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1655/3305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:13.687738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:13.688343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:13.694148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.694625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.695725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.696665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:13.697112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:13.697531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:13.828828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:13.837586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8ba89c90-7c57-4e6d-92d6-864beb9a5a77 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153481 Oct 19 22:24:13.838153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1651/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:14.427300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:14.427890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:14.434313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.434789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.435323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.436004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.436454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.436879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.475171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:14.475779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:14.482768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.483305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.483732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.484413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.484864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.485281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.563620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:14.572009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18d57d36-4ef4-4791-8b9e-4f98deb40f2a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148333 Oct 19 22:24:14.572616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1656/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:14.577062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:14.577697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:14.583313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.583804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.584240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.584934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.585387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.586319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.613019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:14.621651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:14.623108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:14.624267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-af6e1dbe-ce53-47f4-9cd6-53292c4c4f52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152983 Oct 19 22:24:14.624823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1652/3308] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:14.649672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:14.657814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-47d746c6-31c7-470f-9d48-29d815cba155 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084270 Oct 19 22:24:14.658378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1657/3309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:14.860665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:14.861278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:14.867198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.867679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.868111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.868792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:14.869243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:14.869663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:14.997439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:15.005561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-32651e50-e7da-47a9-bc7f-82d7d658c2e2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148838 Oct 19 22:24:15.006127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1653/3310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:15.595909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:15.596523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:15.603602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:15.604110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:15.604546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:15.605232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:15.605688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:15.606111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:15.649330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:15.650114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:15.656476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:15.656963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:15.657410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:15.658125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:15.658582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:15.659034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:15.734460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:15.743390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-77ea9bb1-6ba9-4e33-b83d-0897923e83c0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151277 Oct 19 22:24:15.743961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1658/3311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:15.752944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:15.752944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:15.754699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:15.755212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:15.755648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:15.756335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:15.756786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:15.757213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:15.791531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:15.800476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:15.802032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:15.803351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f7b5a905-91b1-42e7-af85-45ad4c039c37 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157885 Oct 19 22:24:15.803989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1654/3312] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:15.818827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:15.827515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0083f900-d5e6-44c6-b23c-710fec45d959 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082619 Oct 19 22:24:15.828080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1659/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:16.029327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:16.029932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:16.035871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.036349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.036777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.037455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.037901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.038321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.163274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:16.172065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dc6ae787-cbd6-4bb0-a282-03daafd659ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146600 Oct 19 22:24:16.172622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1655/3314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:16.766319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:16.766933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:16.773973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.774453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.774886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.775590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.776041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.776461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.780311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:16.829421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:16.830016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:16.837173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.837655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.838090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.838771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.839261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.839683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.907514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:16.916240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-40b7a7e7-de35-457f-8e7b-04061323debb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153766 Oct 19 22:24:16.916819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1660/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:16.921340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:16.921944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:16.927667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.928159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.928595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.929311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:16.929765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:16.930187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:16.972423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:16.981648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:16.983102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:16.984253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-81fabf1d-8bc6-40c8-a4bd-f9a5f7497903 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158689 Oct 19 22:24:16.984805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1656/3316] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:16.991832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:17.000179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6baf58ba-e234-4a65-acf5-040caeb87663 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082433 Oct 19 22:24:17.000737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1661/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:17.194350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:17.195029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:17.201161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:17.201645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:17.202077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:17.202759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:17.203237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:17.203661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:17.328182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:17.336884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a6134a50-6b90-41bd-b631-08946b02bec1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146339 Oct 19 22:24:17.337463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1657/3318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:17.939778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:17.940424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:17.947292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:17.947769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:17.948189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:17.948871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:17.949314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:17.949731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:18.011840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:18.011840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:18.016781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:18.017338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:18.017864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:18.018564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:18.019044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:18.019472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:18.080458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:18.087123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b142494b-6584-459e-aacf-1b06aff175d7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151093 Oct 19 22:24:18.087737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1662/3319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:18.092211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:18.092813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:18.098643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:18.099165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:18.099605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:18.100290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:18.100929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:18.101914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:18.156191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:18.165505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:18.166964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:18.168154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-67aa76f1-9597-4614-b4d9-2b9f07eebd17 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162596 Oct 19 22:24:18.168707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1658/3320] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:18.172118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:18.180323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cbea73df-d571-48a0-90ac-db3c59fd38e1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.091628 Oct 19 22:24:18.180877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1663/3321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:18.361603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:18.362131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:18.368070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:18.368548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:18.368979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:18.369664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:18.370111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:18.370528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:18.499204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:18.507906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0ca2a91d-c7be-449b-9d01-9b52bb4c2963 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149684 Oct 19 22:24:18.508442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1659/3322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:19.109767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:19.110328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:19.117540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.118023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.118454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.119175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.119626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.120056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.193696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:19.194294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:19.201452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.201936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.202399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.203171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.203630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.204050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.219514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:19.249095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:19.257397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-52586807-073b-40c6-bf28-40a8a6237929 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151495 Oct 19 22:24:19.257974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1664/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:19.262407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:19.263052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:19.268829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.269315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.269748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.270832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.270979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.271296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.332810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:19.339812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:19.341475 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-67d5f680-bb3c-4faa-bdf7-7b1f937bceb7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082501 Oct 19 22:24:19.342054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1665/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:19.348301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:19.349726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:19.350865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b2769880-db6e-44ed-b7b9-d897bf29ab90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161078 Oct 19 22:24:19.352037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1660/3325] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:19.531225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:19.531834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:19.537892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.538372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.539359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.540040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:19.540489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:19.540909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:19.670377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:19.678511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bb423fde-3a6e-4d67-b397-b610b363a421 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151234 Oct 19 22:24:19.679113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1666/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:20.280279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:20.280865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:20.286818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.287328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.287767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.288452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.289416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.289839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.365076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:20.365487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:20.371619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.372185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.372651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.373337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.373785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.374202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.416460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:20.424612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-36719fe3-f336-4519-ba2d-e882983a69c2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148467 Oct 19 22:24:20.425177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1661/3327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:20.429660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:20.430256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:20.435819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.436300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.436442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:20.436733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.437439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.437887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.438303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.444884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-46e1a501-57d0-4eb5-b60b-d4ff5ee11d34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084146 Oct 19 22:24:20.445447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1667/3328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:20.563393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:20.572412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:20.573864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:20.575035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e01f3eef-338d-4d86-9587-5f8e92584fed tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.148939 Oct 19 22:24:20.575587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1662/3329] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:20.701701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:20.702307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:20.708197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.708678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.709107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.709778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:20.710225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:20.711179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:20.836288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:20.844381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d44e9118-d50e-4db4-b10a-11a38f6f7d92 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146509 Oct 19 22:24:20.844938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1668/3330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:21.449011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:21.449607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:21.455936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.456411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.456837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:21.457535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.457981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.458400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:21.468493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:21.469108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:21.475621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.476661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.477106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:21.477798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.478258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.478685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:21.543479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:21.551779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-469abfe1-2739-4d3d-9c37-43a690ecf5d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087055 Oct 19 22:24:21.552345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1669/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:21.592575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:21.601711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-23bafb85-688a-4a72-8bc6-2b5fc6f9ef1b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.156873 Oct 19 22:24:21.602268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1663/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:21.602423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:21.603070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:21.608765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.609240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.609672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:21.610346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.610792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.611244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:21.736301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:21.745237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:21.746659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:21.747876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0964266e-d66e-4581-8316-607e37b2a4c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150170 Oct 19 22:24:21.748429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1670/3333] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:21.867248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:21.867862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:21.873739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.874225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.874661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:21.875377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:21.875879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:21.876309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:22.001542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:22.009791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e9ffc14b-5175-4881-b362-1b6413e7a090 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146452 Oct 19 22:24:22.010350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1664/3334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:22.575779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:22.576390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:22.582838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:22.583358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:22.583801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:22.584492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:22.584948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:22.585400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:22.624906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:22.625745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:22.632992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:22.633562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:22.634085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:22.634888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:22.635564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:22.636159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:22.650512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:22.658680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c42f3ffe-83fa-40b5-bc50-c69d2b21cc25 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087025 Oct 19 22:24:22.660640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1671/3335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:22.773204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:22.773736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:22.779560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:22.780045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:22.780478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:22.781165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:22.781619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:22.782073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:22.849419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:22.857956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3cc5b2fb-4ad2-4702-b5cf-5e95d4bd18dc tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.236803 Oct 19 22:24:22.858719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1665/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:22.916022 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:22.924498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:22.925950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:22.927129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4fc5d65c-af7f-4111-84c9-a7faaa53df10 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158033 Oct 19 22:24:22.927802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1672/3337] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:23.033361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:23.033955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:23.040435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.040918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.041350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:23.042044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.042493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.042910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:23.192375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:23.200782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-391c2af8-79e7-4513-97c2-413c07890d0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.171362 Oct 19 22:24:23.201342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1666/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:23.681082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:23.681698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:23.688273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.688760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.689199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:23.689885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.690341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.690769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:23.751286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:23.759925 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a5c9485c-be38-40be-b139-b68be149c4d9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082688 Oct 19 22:24:23.760492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1673/3339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:23.881586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:23.882212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:23.889252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.889729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.890163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:23.890846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.891324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.891748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:23.953600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:23.954254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:23.960120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.961178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.961624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:23.962316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:23.962772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:23.963224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:24.021585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:24.030450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c651585a-8b96-4b81-aed8-57e3c8246c0b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152681 Oct 19 22:24:24.031069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1667/3340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:24.091320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:24.100205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:24.102300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:24.103480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2fa2a5da-27ff-483d-ad6d-f3d44342e536 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153789 Oct 19 22:24:24.104043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1674/3341] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:24.224143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:24.224758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:24.231321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:24.234765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:24.234765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:24.234765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:24.234765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:24.235234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:24.360123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:24.368248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-07ea6ff4-5306-46ff-a1c1-160ce2f34b72 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148023 Oct 19 22:24:24.368811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1668/3342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:24.783171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:24.783808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:24.790462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:24.790943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:24.791400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:24.792082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:24.792644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:24.793063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:24.856233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:24.864303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-38f178e3-6b97-47d0-922a-db0a8d69b1d7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085000 Oct 19 22:24:24.864855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1675/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:25.054772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:25.055365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:25.061991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.062477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.062916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.063632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.064081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.064501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.128630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:25.129277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:25.135875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.136369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.136811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.137502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.137959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.138385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.194273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:25.203359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-77dc2c8a-29ee-4cdd-8ece-98c5a95707f8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153053 Oct 19 22:24:25.203931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1669/3344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:25.264391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:25.266558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:25.273433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:25.274965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:25.276191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8e00dad0-45bf-41bd-a238-406a2ffd0f42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151469 Oct 19 22:24:25.292389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1676/3345] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:25.390910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:25.391487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:25.397862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.399023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.399470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.400168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.400627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.401053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.527955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:25.536052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-634fb7a8-7d46-4c82-a7f2-bba3466ed681 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149029 Oct 19 22:24:25.536618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1670/3346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:25.887979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:25.888580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:25.895187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.895665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.896094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.896766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:25.897213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:25.897631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:25.957791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:25.966167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3b998b9e-7b85-4ea8-9fa7-6639895d68f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082332 Oct 19 22:24:25.966725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1677/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:26.227085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:26.227701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:26.234101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.234581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.235057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:26.235741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.236195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.236621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:26.316567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:26.317171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:26.323616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.324137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.324565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:26.325246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.325695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.326117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:26.363837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:26.372277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d244a005-3e1b-43c8-83f1-d11a1be23b86 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149708 Oct 19 22:24:26.372852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1671/3348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:26.456525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:26.465443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:26.466867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:26.468037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e4747c81-1244-4a80-8c37-0fd61755f552 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155416 Oct 19 22:24:26.468612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1678/3349] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:26.558860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:26.559524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:26.565303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.565722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.566151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:26.566827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.567300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.567719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:26.694080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:26.702382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ee3f50ec-0477-438e-af25-b97d39ecfce9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147279 Oct 19 22:24:26.702945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1672/3350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:26.989477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:26.990088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:26.997313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.997790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.998225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:26.998908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:26.999390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:26.999815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:27.060260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:27.068458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-947f3cac-fc5a-4785-9e73-33c2ca66f418 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082796 Oct 19 22:24:27.069019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1679/3351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:27.394734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:27.395327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:27.405891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:27.406380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:27.406820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:27.407548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:27.408006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:27.408438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:27.493541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:27.494151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:27.500067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:27.500552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:27.500989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:27.501674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:27.502129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:27.502554 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:27.536189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:27.544507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-52cdca92-8174-4a67-acd6-2ecc5eb42fde tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153757 Oct 19 22:24:27.545070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1673/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:27.628479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:27.637545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:27.639037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:27.640190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-053391b8-78c6-43b6-94e0-f95d58023bf0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150472 Oct 19 22:24:27.640742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1680/3353] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:27.726279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:27.726892 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:27.732781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:27.733261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:27.733693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:27.734376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:27.734823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:27.735272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:27.864761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:27.873275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-60174c34-78ff-4368-a163-6bbff8e5b4c8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150886 Oct 19 22:24:27.873831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1674/3354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:28.091221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:28.091825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:28.094226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:24:28.094352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:24:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 (ip 10.222.0.20) !!! Oct 19 22:24:28.095378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:24:28.095491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:24:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 (ip 10.222.0.20) !!! Oct 19 22:24:28.103980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.104458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.104891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:28.105574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.106019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.106437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:28.170252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:28.178415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ef905551-58fb-462b-a314-f2f960829a28 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.091072 Oct 19 22:24:28.179023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1681/3355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:28.566500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:28.567150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:28.574313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.574725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.575195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:28.575869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.576315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.576734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:28.665725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:28.666430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:28.672381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.672937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.673465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:28.674227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.674749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.675268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:28.703127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:28.711317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5e514a85-37cf-40dc-b4ee-e8ce2e476cb7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148550 Oct 19 22:24:28.711883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1675/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:28.801396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:28.810368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:28.811862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:28.813014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7ef7ff9e-e0ea-408b-a7a3-ab9f465e9b45 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151303 Oct 19 22:24:28.813569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1682/3357] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:28.896516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:28.897055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:28.898857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:28.903435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.903905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.904334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:28.905010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:28.905458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:28.905902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:29.039094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:29.043117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f7ccb931-1b9f-4d02-93b3-11ad114ee938 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150434 Oct 19 22:24:29.043765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1676/3358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:29.201083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:29.201730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:29.208135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:29.208620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:29.209061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:29.209745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:29.210198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:29.210624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:29.272184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:29.280231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2e6c14f0-47b9-4cec-9dd4-8be4a51bc5bd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083278 Oct 19 22:24:29.280784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1683/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:29.733700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:29.734376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:29.736358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:24:29.736505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 (ip 10.222.0.20) !!! Oct 19 22:24:29.738452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:24:29.738579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 (ip 10.222.0.20) !!! Oct 19 22:24:29.756400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:29.756882 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:29.757831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:29.758528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:29.759013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:29.759441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:29.762110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:29.839319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:29.840045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:29.845957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:29.846447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:29.846882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:29.847621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:29.848076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:29.848499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:29.891829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:29.900777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a4ac5df4-d02d-42a0-9dab-50dc4adb363e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.171057 Oct 19 22:24:29.901339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1677/3360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:29.984557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:29.993472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:29.994898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:29.996072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-56b0128b-e35f-4ef4-8009-27c92b30e931 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161301 Oct 19 22:24:29.996623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1684/3361] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:30.066095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:30.066708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:30.073795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:30.074288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:30.074728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:30.075452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:30.075911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:30.076340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:30.207199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:30.215313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-40182bea-de1c-4b44-a3d7-a85c897c3490 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152987 Oct 19 22:24:30.215878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1678/3362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:30.302156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:30.302689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:30.309581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:30.310085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:30.310518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:30.311225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:30.311675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:30.312093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:30.374232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:30.383105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-50afadac-2584-4eea-862e-d9234ddade83 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084161 Oct 19 22:24:30.383669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1685/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:30.924564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:30.925174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:30.932106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:30.932584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:30.933017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:30.933701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:30.934152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:30.934570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:31.021592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:31.022322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:31.028506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:31.029082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:31.029582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:31.030343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:31.030862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:31.031322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:31.064622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:31.073840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-be017285-f223-4fa0-a8d8-e6735aefd27b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153085 Oct 19 22:24:31.074423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1679/3364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:31.155995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:31.164502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:31.165948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:31.167126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-360793e5-5774-4af6-8642-98a46fce2c42 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149417 Oct 19 22:24:31.167686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1686/3365] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:31.237917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:31.238534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:31.245058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:31.245542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:31.245982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:31.246668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:31.247161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:31.247589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:31.375354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:31.383474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2462b804-6f4a-46da-9592-aa6f88d7b2c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149873 Oct 19 22:24:31.384047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1680/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:31.407366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:31.407978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:31.410969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:31.417061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:31.417549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:31.417994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:31.418696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:31.419177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:31.419606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:31.486100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:31.494891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bd858b09-758d-4be3-a6dd-80e96d6b6ed3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.092854 Oct 19 22:24:31.495485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1687/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:32.096752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:32.097368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:32.103758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.104241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.104677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.105360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.105813 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.106245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.192542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:32.193161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:32.199836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.200326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.200761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.201452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.201906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.202330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.236026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:32.244243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-102e39c1-f6fc-48f2-93a9-db10c0d22814 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151291 Oct 19 22:24:32.244828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1681/3368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:32.329877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:32.339131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:32.340589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:32.341755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6304aab2-5c1e-4b92-8bdb-5e0112fe9797 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153106 Oct 19 22:24:32.342309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1688/3369] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:32.408023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:32.408635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:32.414571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.415090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.415532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.416225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.416681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.417136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.517508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:32.518121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:32.524522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.525013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.525451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.526142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:32.526598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:32.527050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:32.542264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:32.550440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b408e6fc-385c-4903-bb4d-3a75847e641e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146213 Oct 19 22:24:32.551035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1682/3370] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:32.588121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:32.596355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-73b96bf4-aae7-457d-9774-846bd8f62355 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082671 Oct 19 22:24:32.596927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1689/3371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:33.329932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:33.330546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:33.337011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.337487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.337918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.338590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.339067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.339486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.366846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:33.367476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:33.373424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.374000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.374434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.375145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.375593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.376011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.470901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:33.479842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-331b19ac-3da4-45ce-9ef4-f76c4a866d90 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.215749 Oct 19 22:24:33.480599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1683/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:33.508070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:33.516429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:33.517850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:33.519014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-83a31095-1b8a-4579-8c11-c2bbae047120 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156070 Oct 19 22:24:33.519562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1690/3373] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:33.574144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:33.574693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:33.580515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.580990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.581434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.582098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.582549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.582988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.623035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:33.623683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:33.630170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.630732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.631209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.631923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:33.632455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:33.632884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:33.697083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:33.705324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-449e314e-2435-47a8-92b6-10fe18927c81 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.090339 Oct 19 22:24:33.705902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1691/3374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:33.713551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:33.722133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8277da8b-3cee-4837-96f3-f5402e60ce0e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152118 Oct 19 22:24:33.722692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1684/3375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:34.501683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:34.502291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:34.508257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.508745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.509180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.509860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.510312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.510733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.544774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:34.545373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:34.551796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.552282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.552711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.553397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.553849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.554878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.637216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:34.645644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-51b3026e-b589-447a-88d0-7db9cf751f39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147818 Oct 19 22:24:34.646346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1692/3376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:34.681187 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:34.689590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:34.691050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:34.692199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a7a0125-1e96-43ab-93b7-9dd0c312ef30 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151219 Oct 19 22:24:34.692758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1685/3377] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:34.728966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:34.729573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:34.735481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.735966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.736403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.737085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.737537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.737958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.745091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:34.745693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:34.751560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.752083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.752463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.753140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:34.753429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:34.753573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:34.754390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:34.804090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:34.812320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-515d3302-8f93-4553-8f75-713f05aec0d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087846 Oct 19 22:24:34.812891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1693/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:34.886238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:34.894373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f81474bd-33ca-4cdb-aa0c-f26cbe1c6c42 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152959 Oct 19 22:24:34.894934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1686/3379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:35.669397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:35.670006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:35.676384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.676870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.677309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:35.677993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.678447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.678871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:35.717308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:35.717922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:35.724494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.724984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.725420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:35.726616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.727090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.727519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:35.809059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:35.817379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2c8afde2-3762-4467-886f-e699158d8b55 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151881 Oct 19 22:24:35.817955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1694/3380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:35.836293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:35.836927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:35.842697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.843276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.843713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:35.844426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.844880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.845301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:35.856313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:35.864850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:35.866293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:35.868087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-33b1ba06-c8bb-49a2-8013-e68a60703499 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154621 Oct 19 22:24:35.868658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1687/3381] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:35.905546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:35.914470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-eddac56b-b2a0-41f6-8577-bd54701529d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082043 Oct 19 22:24:35.915053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1695/3382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:35.918101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:35.918715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:35.924742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.925164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.925603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:35.926296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:35.926754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:35.927208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:36.053851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:36.062549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5a66b6c0-93a7-4e7f-aa75-373f2aee12ae tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148867 Oct 19 22:24:36.063133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1688/3383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:36.841496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:36.842111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:36.848539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:36.849021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:36.849455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:36.850139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:36.850595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:36.851044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:36.893377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:36.893968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:36.900292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:36.900765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:36.901192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:36.901872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:36.902317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:36.902737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:36.982522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:36.990715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03b5847e-10a8-4e8a-9f2f-dd9a0d87c28e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153055 Oct 19 22:24:36.991310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1696/3384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:36.996284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:36.996880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:37.002728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:37.003218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:37.003720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:37.004328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:37.004779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:37.005191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:37.031933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:37.040794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:37.042186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:37.043454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-72e9d691-de18-4f9f-a3d8-78b368f3a6f1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153957 Oct 19 22:24:37.044021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1689/3385] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:37.068245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:37.077003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c6ecf21d-e2b3-410b-8639-ab500d5c2d57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084243 Oct 19 22:24:37.077559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1697/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:37.085422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:37.086036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:37.091911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:37.092398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:37.092837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:37.093526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:37.093982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:37.094423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:37.217320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:37.225395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d5d79baa-1e30-4e68-b77f-89227e5c04b4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.143747 Oct 19 22:24:37.226530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1690/3387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:38.014517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:38.015175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:38.021689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.022095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.022523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.023870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.024328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.024746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.068987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:38.070102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:38.077058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.077535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.077969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.078659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.079142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.079571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.154029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:38.162410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-81cdf913-4977-4cf3-99c1-bf601a9d2559 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151713 Oct 19 22:24:38.163006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1698/3388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:38.167626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:38.168258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:38.174213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.174501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.174939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.175739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.176200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.176624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.212798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:38.221461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:38.222893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:38.224076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-298fec6f-5a00-46e2-bb66-2adc2069170c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.159071 Oct 19 22:24:38.224833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1691/3389] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:38.241899 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:38.248823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:38.249465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:38.250326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6975cdb3-a1b9-47d1-b01b-efdbe4b20ad2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086353 Oct 19 22:24:38.251096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1699/3390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:38.255372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.255876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.256296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.256986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:38.257973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:38.258397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:38.383437 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:38.391552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0cb4867b-7ae8-4f11-916c-90b79fc13700 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146552 Oct 19 22:24:38.392122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1692/3391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:39.185802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:39.186395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:39.192935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.193412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.193848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.194532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.195052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.195472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.249431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:39.250034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:39.256589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.257122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.257511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.258205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.258658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.259121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.331472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:39.340217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17451a7e-87e1-48ba-8b26-9af56b89a1fd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.158311 Oct 19 22:24:39.340793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1700/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:39.357909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:39.358490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:39.364429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.364908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.365337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.366019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.366504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.366927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.400885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:39.403172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:39.411767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:39.413999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:39.415204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2470433e-81b4-43f1-9ccd-0c72cd216158 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.169918 Oct 19 22:24:39.424334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1693/3393] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:39.424334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:39.424334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:39.426430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.427072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.427400 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.428085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:39.428531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:39.428735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:39.428941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:39.438371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6e35328e-501e-4df5-9089-d3b44107df2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084043 Oct 19 22:24:39.439081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1701/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:39.556967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:39.565022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d2eb1ef6-41e5-4436-96ca-53d8b443a1ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148354 Oct 19 22:24:39.565585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1694/3395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:40.362714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:40.363287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:40.370223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.370694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.371149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.371826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.372298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.372720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.448364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:40.448959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:40.455346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.456078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.456377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.457062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.457512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.457928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.503062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:40.511340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3d7759c4-d182-48f6-8915-4a164a57d320 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152501 Oct 19 22:24:40.511915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1702/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:40.516287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:40.517036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:40.522671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.523188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.523653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.524336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.524787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.525202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.586981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:40.587189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:40.595159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fb476faf-25ee-4bd1-b9f0-9802bbd7d7cb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082271 Oct 19 22:24:40.595646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:40.595775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1703/3397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:40.597161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:40.598320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-050fca84-0204-4c18-a97e-f2fdf95a00d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154137 Oct 19 22:24:40.599043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1695/3398] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:40.600101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:40.600734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:40.607279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.607828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.608331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.609081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:40.609617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:40.610118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:40.733629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:40.742054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a539a83f-d16b-48fa-8505-563fd9d34052 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145413 Oct 19 22:24:40.742623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1704/3399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:41.535128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:41.535778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:41.542251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.542740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.543211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.543910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.544356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.544784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.618029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:41.618631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:41.625050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.625534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.625970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.626650 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.627138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.627553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.693886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:41.693886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1f781a52-cff4-45e1-99d6-8f7647646efe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.162331 Oct 19 22:24:41.695602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:41.705274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c68edc69-d8bb-4aba-a1ac-158de80bccf1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.091559 Oct 19 22:24:41.718979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1705/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:41.719190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1696/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:41.719305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:41.719305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:41.719305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.719305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.719748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.719748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.719748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.719748 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.766317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:41.766961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:41.773091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.773583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.774024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.774720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:41.775207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:41.775636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:41.864248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:41.875876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:41.882427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:41.882427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2328f964-d61b-4bf1-8eb9-742cdcb8918f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.172091 Oct 19 22:24:41.891550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1706/3402] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:41 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:41.933490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:41.941641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9bda7cac-ca68-4bc7-ac42-852159f07507 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.179151 Oct 19 22:24:41.942201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1697/3403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:42.717885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:42.718491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:42.724947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.725429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.725865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:42.726556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.727032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.727456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:42.728385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:42.728991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:42.735313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.735786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.736218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:42.736902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.737355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.737772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:42.803856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:42.811998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-af6e1a2b-b59f-415d-8fab-d8fb79a5baa4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087373 Oct 19 22:24:42.812552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1698/3404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:42.858857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:42.867585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ee9e3e48-49cc-4f6a-ba8e-57bf172bf825 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153620 Oct 19 22:24:42.868144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1707/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:42.905654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:42.906255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:42.912025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.912500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.912927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:42.913601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.914042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.914456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:42.966085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:42.966802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:42.972832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.973327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.973829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:42.974609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:42.975169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:42.975664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:43.040689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:43.049588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:43.051150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:43.052451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e3627ec3-367e-4811-b9a5-c2d8b24a186a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150651 Oct 19 22:24:43.053232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1699/3406] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:43.106220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:43.114856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fd09fef9-5a79-45a3-8b10-db4d103842bb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152681 Oct 19 22:24:43.115551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1708/3407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:43.836499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:43.837223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:43.843536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:43.844014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:43.844442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:43.845119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:43.845564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:43.845983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:43.891180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:43.891825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:43.898919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:43.899362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:43.899832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:43.900523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:43.900976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:43.901394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:43.909220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:43.917911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a38b349e-a966-43b6-80ee-babc342a41d8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085811 Oct 19 22:24:43.918481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1700/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:43 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:44.028950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:44.037110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7ac97897-20bf-4fbc-81e2-4a1cdceeab07 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149920 Oct 19 22:24:44.037674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1709/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:44.079897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:44.080526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:44.088047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:44.088530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:44.088961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:44.089645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:44.090124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:44.090545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:44.139150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:44.139760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:44.145581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:44.146089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:44.146520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:44.147305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:44.147805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:44.148730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:44.151337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:44.223472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:44.232554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:44.234113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:44.235303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-857c0f46-f43f-441b-b862-dc4d34044280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.159193 Oct 19 22:24:44.236088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1701/3410] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:44.285985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:44.294162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17efa020-2ee8-49fb-82ab-df1bdd3208fa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.158844 Oct 19 22:24:44.294723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1710/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:44.940227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:44.940839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:44.947799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:44.948290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:44.948755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:44.949449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:44.949932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:44.950355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:45.010558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:45.018589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-771ce517-c0f8-4046-891b-463ad1290a24 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082236 Oct 19 22:24:45.019181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1702/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:45.060479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:45.061015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:45.067415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:45.067901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:45.068347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:45.069032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:45.069488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:45.069911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:45.194072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:45.202426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e9036e7d-bfd5-4e8d-864a-3bc50456af9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145967 Oct 19 22:24:45.203010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1711/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:45.260629 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:45.261238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:45.267144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:45.267615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:45.268047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:45.268731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:45.269184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:45.269607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:45.316494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:45.317147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:45.323383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:45.323937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:45.324446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:45.325199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:45.325725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:45.326218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:45.396536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:45.405752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:45.407229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:45.408394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2161f52b-d257-4a3c-a645-2b6c2239a596 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151697 Oct 19 22:24:45.408959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1703/3414] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:45.455795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:45.465396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-78392c99-349d-4f46-a996-797e890ebd33 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152737 Oct 19 22:24:45.466042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1712/3415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:46.041212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:46.041815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:46.048125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.048608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.049046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.049727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.050181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.050605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.114412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:46.123074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b1033145-ebf1-43d8-b500-c6cbb3e2047f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085914 Oct 19 22:24:46.123637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1704/3416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:46.225319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:46.226440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:46.232841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.233314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.233765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.234418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.234865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.235310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.363337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:46.372103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1a902dd7-4271-47db-b379-358cc6c14914 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150649 Oct 19 22:24:46.372705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1713/3417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:46 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:46.434146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:46.434756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:46.440756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.441242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.441683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.442367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.442826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.443279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.489613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:46.490247 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:46.496711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.497188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.497620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.498295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:46.498741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:46.499188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:46.571134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:46.579844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:46.581274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:46.582423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-162b3052-0389-4dca-be81-6787f2e149f2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152235 Oct 19 22:24:46.583020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1705/3418] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:46.626115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:46.634256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac93da35-34e2-47fa-923b-b3c6504dbd9e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148525 Oct 19 22:24:46.634822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1714/3419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:47.146224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:47.146860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:47.153871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.154344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.154781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.155485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.155932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.156347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.218058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:47.226191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-52bd563f-6d30-44a7-a4bd-562f27643545 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083830 Oct 19 22:24:47.226751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1706/3420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:47.395091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:47.395704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:47.402772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.403231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.403675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.404358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.404839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.405258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.539082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:47.547118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2a449edc-d6b5-44a9-b83b-f913beefa6e5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155932 Oct 19 22:24:47.547675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1715/3421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:47.607973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:47.608577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:47.614416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.614897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.615364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.616044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.616596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.617366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.657702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:47.658225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:47.664912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.665394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.665846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.666532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:47.666994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:47.667413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:47.746938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:47.755773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:47.757730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:47.759038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2a833b98-b11c-4644-8e56-2a31e81e6f1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154923 Oct 19 22:24:47.760063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1707/3422] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:47.802441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:47.810535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0d8593e7-e560-4fc8-b31c-6d9cf31729b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.156754 Oct 19 22:24:47.815032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1716/3423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:48.248764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:48.249393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:48.255836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.256322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.256758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.257448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.257905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.258327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.318439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:48.326895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-98f238f5-4241-4d09-bdd1-db7e8a2c746c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082048 Oct 19 22:24:48.327472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1708/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:48.569694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:48.570235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:48.576864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.577346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.577782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.578467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.578917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.579363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.708374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:48.716477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-287882c2-b443-4cac-b0ab-c352d32f1d17 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150765 Oct 19 22:24:48.717048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1717/3425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:48.785268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:48.785878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:48.792667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.793155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.793587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.794278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.794728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.795185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.834829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:48.835991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:48.841892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.842375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.842814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.843531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:48.843984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:48.844407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:48.924055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:48.938411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:48.938411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:48.938411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-58f46544-2907-4f4f-a901-d4c6556ad03e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153541 Oct 19 22:24:48.938736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1709/3426] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:48 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:48.983523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:48.991647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9e14effa-14bb-4ff6-829c-c4d3e89e97d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.160642 Oct 19 22:24:48.995162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1718/3427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:49.349620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:49.350230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:49.356588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:49.357141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:49.357577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:49.358290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:49.358744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:49.359200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:49.373668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:49.422801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:49.430728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8238333a-59d2-4124-8a01-edd7ed1e57a7 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085011 Oct 19 22:24:49.431314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1710/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:49.739901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:49.740495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:49.747462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:49.747937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:49.748368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:49.749040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:49.749491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:49.749990 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:49.876629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:49.885431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e6b58647-9936-4fea-9e01-3af7913b5a23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149400 Oct 19 22:24:49.885988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1719/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:49.961717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:49.962322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:49.968193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:49.968678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:49.969115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:49.969797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:49.970248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:49.970671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:50.016384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:50.016916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:50.022804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:50.023310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:50.023741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:50.024420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:50.024872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:50.025289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:50.097652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:50.106935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:50.108374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:50.109526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-df822602-4842-4381-ba42-c0accaa0db28 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151905 Oct 19 22:24:50.110085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1711/3430] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:50.154941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:50.163125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-10ac361d-dd01-4a29-8498-74695c5a6993 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150869 Oct 19 22:24:50.164390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1720/3431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:50 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:50.453859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:50.454474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:50.460849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:50.461333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:50.461771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:50.462449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:50.462902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:50.463349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:50.524069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:50.531987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c701312f-93e9-4ba8-a857-b471fe010f38 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082042 Oct 19 22:24:50.532546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1712/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:50.908153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:50.908752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:50.915239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:50.915716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:50.916145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:50.916823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:50.917267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:50.917684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:51.041993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:51.050166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76e21ee7-b7fb-456f-91dd-f3c11962f53c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145856 Oct 19 22:24:51.050731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1721/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:51.136118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:51.136723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:51.143075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:51.143553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:51.144322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:51.145001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:51.145450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:51.145874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:51.187839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:51.188478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:51.194224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:51.195338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:51.195768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:51.196450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:51.196897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:51.197575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:51.276785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:51.285462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:51.286905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:51.288104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a58b7e77-cdcc-482a-ad77-28db6e2656c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156487 Oct 19 22:24:51.288677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1713/3434] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:51.328209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:51.336282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-52b86da7-a710-4264-9afd-405107fadc1c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152286 Oct 19 22:24:51.336850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1722/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:51.555474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:51.556074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:51.562101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:51.562583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:51.563052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:51.563735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:51.564181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:51.564624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:51.625953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:51.634361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6a7c1ad1-1e28-4486-b9a2-ebef2acc4035 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083409 Oct 19 22:24:51.634918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1714/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:52.073886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:52.074508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:52.081002 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.081489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.081934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.082628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.083115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.083549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.208277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:52.217548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ad1805d0-4f8f-4bb0-887a-52c9f5c59bee tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147784 Oct 19 22:24:52.218131 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1723/3437] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:52.313704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:52.314310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:52.321321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.321767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.322456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.323181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.323634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.324055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.359319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:52.359923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:52.366019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.366501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.366931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.367710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.368188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.368607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.453980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:52.463570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:52.465063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:52.466226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-15c490e6-bda0-4f44-8a49-6f7514c8dcc0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156506 Oct 19 22:24:52.466785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1715/3438] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:52.499697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:52.508471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cabd8a01-6aa6-43a7-992e-4115ac4c1184 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153114 Oct 19 22:24:52.509035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1724/3439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:52.656657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:52.657256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:52.663105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.664140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.664570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.665245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:52.665691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:52.666108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:52.728229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:52.736226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e50b8b35-dbdb-45f3-a134-9c2c218ba089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083357 Oct 19 22:24:52.736785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1716/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:53.240934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:53.241543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:53.248030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.248508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.248940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.249623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.250072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.250493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.375090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:53.383797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab32018d-7c0e-4452-a14d-3a9fd1cb2960 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146733 Oct 19 22:24:53.384364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1725/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:53 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:53.491798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:53.492363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:53.498713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.499227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.499664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.500344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.500797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.501218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.534485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:53.535658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:53.543680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.544367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.544812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.545511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.545964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.546388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.631817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:53.641116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:53.642558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:53.643750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-043b08f7-49f1-434f-836c-afb2a3095dcf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156447 Oct 19 22:24:53.644306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1717/3442] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:53.672732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:53.674898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:53.685517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-95ab4c57-1ba9-44b8-992f-1458d57038ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.156044 Oct 19 22:24:53.697505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1726/3443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:53.757927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:53.758561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:53.764495 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.764973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.765413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.766095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:53.766547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:53.766983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:53.826864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:53.835156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dc2b7367-cb09-46f6-856d-239dba2a5650 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081119 Oct 19 22:24:53.835728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1718/3444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:54.406932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:54.407540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:54.414848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.415352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.415786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.416515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.416962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.417377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.544798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:54.552868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b01b091-91ff-4db4-95d3-b7c2472c6408 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150251 Oct 19 22:24:54.553430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1727/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:54.669447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:54.669989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:54.676347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.676825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.677260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.677941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.678392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.678816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.718647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:54.719328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:54.725221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.725717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.726156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.726900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.727379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.727803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.809133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:54.817888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:54.819953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:54.821297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7032ccd1-e1d3-4127-b38c-ce7023a5b543 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155777 Oct 19 22:24:54.821864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1719/3446] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:54.857482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:54.858092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:54.858591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:54.864023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.864511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.864952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.865640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:54.866095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:54.867053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:54.867174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a446d58a-7356-426d-b81f-7ff8b283c849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151752 Oct 19 22:24:54.867741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1728/3447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:54.926822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:54.935320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-57167696-8509-49c8-aacd-0e47b454bac2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081566 Oct 19 22:24:54.935876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1720/3448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:54 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:55.576976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:55.577588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:55.584017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:55.584495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:55.584964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:55.586129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:55.586582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:55.587043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:55.721023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:55.730043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c1ca3deb-8bcc-4f5f-9a8a-eb469a431133 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.157109 Oct 19 22:24:55.730600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1729/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:55.847180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:55.847724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:55.854592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:55.855102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:55.855538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:55.856207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:55.856652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:55.857066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:55.892301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:55.892903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:55.899337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:55.899828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:55.900258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:55.900943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:55.901395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:55.901812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:55.985075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:55.993780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:55.995267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:55.996436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b3fd4942-8bca-40be-825d-dae95d602ba3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153246 Oct 19 22:24:55.996997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1721/3450] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:55 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:56.001407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:56.002009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:56.008202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:56.008685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:56.009118 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:56.009800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:56.010247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:56.010668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:56.032414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:56.040892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-82303d67-71c8-48f0-b687-0d2649144e46 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152340 Oct 19 22:24:56.054976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1730/3451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:56.074398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:56.082531 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dec7388e-c4b1-4244-b8ce-415a34a51888 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084607 Oct 19 22:24:56.083103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1722/3452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:56.753080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:56.753696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:56.760391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:56.760876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:56.761317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:56.762010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:56.762465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:56.762891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:56.891915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:56.900613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0c19518a-ee5f-485f-a1f4-ddfedb043137 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151453 Oct 19 22:24:56.901182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1731/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:57.022166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:57.023341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:57.029678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.030162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.030601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:57.031319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.031774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.032199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:57.063754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:57.064406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:57.070932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.071445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.071884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:57.072834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.073288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.073711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:57.210342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:57.218361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e05e159d-5fd0-4949-a5a3-d4c06a9aabbe tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.158334 Oct 19 22:24:57.218979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1732/3454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:57 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:57.223914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:57.224528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:57.230805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.231336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.231775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:57.232561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.233011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.233433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:57.296284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:57.305167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-562ffed6-2ccd-444b-a58e-6891a5e817d5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085141 Oct 19 22:24:57.306179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1733/3455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:57.365654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:57.374563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:57.376034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:57.377201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9e7c93cb-83c1-4a1f-8405-1581260a8d90 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.359002 Oct 19 22:24:57.377765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1723/3456] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:24:57.923511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:57.924118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:57.930623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.931138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.931578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:57.932262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:57.932709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:57.933135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:58.061103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:58.071875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f7fef574-0b27-4b31-a898-350d2180520c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149736 Oct 19 22:24:58.071875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1734/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:58.241557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:58.242171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:58.248652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:58.249133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:58.249570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:58.250282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:58.250719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:58.251185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:58.328239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:58.328883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:58.334837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:58.336009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:58.336454 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:58.337149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:58.337612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:58.338039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:58.378700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:58.387562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-882687ca-7224-4c66-8ff1-98957552f03f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149853 Oct 19 22:24:58.388140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1724/3458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:58.399012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:58.404422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:58.405035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:58.407268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dcb2a51f-ec49-4d10-ac98-08c852f76b2e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082804 Oct 19 22:24:58.407853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1735/3459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:58.411154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:58.411630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:58.412058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:58.412859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:58.413344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:58.413764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:58.542501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:58.551005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:58.552446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:58.553606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f66c02a6-1f5e-4962-8165-94e1ce591360 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153378 Oct 19 22:24:58.554156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1725/3460] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:24:59.091918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:59.092528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:59.098913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.099428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.099864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.100547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.101517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.101939 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.227477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:59.235611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-79545328-7710-421d-ae22-5e301300c3f2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147645 Oct 19 22:24:59.236178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1736/3461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:59.411455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:59.412012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:59.415216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:59.419821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.420349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.420781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.421458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.421904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.422322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.429426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:59.430036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:59.431897 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:24:59.436560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.437050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.437490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.438177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.438630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.439086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.504023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:59.512398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3d7c9ca0-18e4-449f-bbb3-f0b8cdc04dcb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086747 Oct 19 22:24:59.513262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1737/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:24:59.557759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:59.565948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-31625aef-080d-4a5b-a612-7e72be3ac689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.158400 Oct 19 22:24:59.566513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1726/3463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:24:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:24:59.580703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:24:59.581405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:24:59.587885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.588362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.588795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.589472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:24:59.589916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:24:59.590330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:24:59.713776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:59.722104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:59.723559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:24:59.724700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-93a3a858-9425-4836-9bb6-cfc0029f6fa8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.147862 Oct 19 22:24:59.725255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1738/3464] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:24:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:00.260115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:00.260731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:00.267067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.267548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.267982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.268722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.269233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.269660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.273551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:00.397350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:00.405904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c9c7b1d5-a9b6-4f95-b3a4-d3932615ee18 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150862 Oct 19 22:25:00.406466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1727/3465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:00 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:00.535393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:00.535995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:00.542917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.543421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.543851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.544526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.544975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.545390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.589344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:00.589939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:00.596377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.596858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.597289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.598026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.598419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.598838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.607711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:00.615786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4446a983-153d-426b-b01e-7e4dd6c17080 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084166 Oct 19 22:25:00.616920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1739/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:00.726298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:00.734374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1fd50c20-20f8-4f55-867a-463503ed1122 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148842 Oct 19 22:25:00.734927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1728/3467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:00.753600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:00.754209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:00.760108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.760590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.761029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.761716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:00.762170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:00.762592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:00.890903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:00.899936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:00.901391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:00.902550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d7d53ca2-e4a2-4ba1-9116-a3b543f590c0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152844 Oct 19 22:25:00.903149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1740/3468] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:01.428695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:01.429301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:01.435179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.435660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.436088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:01.436761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.437206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.437623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:01.570556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:01.578993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-705def4e-4763-4f00-ba32-7856ba3fb61d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154177 Oct 19 22:25:01.579552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1729/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:01.638836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:01.639468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:01.645810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.646287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.646718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:01.647426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.647873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.648290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:01.709761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:01.717827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8ca25d0b-bc4b-44cd-a458-fe073f670d8d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082827 Oct 19 22:25:01.718389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1741/3470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:01.758213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:01.758976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:01.765322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.765798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.766226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:01.766909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.767408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.767829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:01.894635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:01.903012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9aaa4719-af4c-457f-a7b3-8d04f8c5065d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149162 Oct 19 22:25:01.903572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1730/3471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:01.928379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:01.929512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:01.935290 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.935768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.936197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:01.936869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:01.937315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:01.937732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:02.062390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:02.070915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:02.072618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:02.073771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa6d5605-1bdd-4bdc-a2d7-86791b1a2aa0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149207 Oct 19 22:25:02.074324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1742/3472] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:02.603969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:02.604579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:02.610522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:02.611019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:02.611452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:02.612129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:02.612575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:02.612993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:02.736801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:02.740217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:02.740854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:02.744926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-626012ca-721b-4e3b-98f2-5f9e13cf247b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145438 Oct 19 22:25:02.745482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1731/3473] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:02.747294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:02.747780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:02.748221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:02.748910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:02.749364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:02.749854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:02.764975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:02.814029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:02.823437 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c9c7df16-7915-4518-a4ae-e951ab075d68 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087050 Oct 19 22:25:02.824006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1743/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:02.925752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:02.926283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:02.932540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:02.933015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:02.933446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:02.934150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:02.934597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:02.935049 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:03.062816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:03.071507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bd031773-b860-4bac-b8e5-e88c32dd216b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149823 Oct 19 22:25:03.072082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1732/3475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:03.098238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:03.098877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:03.104717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:03.105201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:03.105636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:03.106326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:03.106784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:03.107237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:03.231487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:03.239891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:03.241827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:03.243335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9b3868a5-7e64-4862-8f16-4e20fac8e60f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.148880 Oct 19 22:25:03.243894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1744/3476] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:03.767843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:03.768451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:03.775149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:03.775624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:03.776052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:03.776728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:03.777174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:03.777589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:03.845841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:03.846480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:03.852850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:03.853332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:03.853766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:03.854697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:03.855083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:03.855512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:03.906978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:03.915991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-42e7fdea-96e5-4c5a-946e-a53e4cb0a29f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151765 Oct 19 22:25:03.927861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1733/3477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:03.928617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:03.928617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a18d61cb-1ec4-4076-865e-ba331d597ed8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084917 Oct 19 22:25:03.928617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1745/3478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:04.095505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:04.096140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:04.102454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.102930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.103389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:04.104069 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.104516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.104934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:04.240481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:04.243279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-66a9cb5a-be87-4543-b965-5822e5507e88 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151540 Oct 19 22:25:04.243842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1734/3479] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:04 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:04.268811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:04.269604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:04.275489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.275963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.276392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:04.277070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.277517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.277935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:04.405097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:04.414246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:04.415706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:04.416854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ae9ebcb1-64b0-425c-a4ee-994a76d84647 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152305 Oct 19 22:25:04.417418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1746/3480] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:04.940590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:04.941184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:04.947304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.948062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.948498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:04.949194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.949651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.949776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:04.950207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:04.950404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:04.957036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.957515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.957946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:04.958624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:04.959106 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:04.959523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:05.021676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:05.030692 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1ee53495-a5d9-42d3-ac7c-2eb6782f6e88 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085023 Oct 19 22:25:05.031632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1747/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:04 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:05.077417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:05.086017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-014d3027-f96e-4d7e-8531-824827d473ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148694 Oct 19 22:25:05.086579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1735/3482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:05.266834 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:05.267474 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:05.273937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:05.274416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:05.274855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:05.275558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:05.276010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:05.276430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:05.401089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:05.409164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7807442b-5a96-4dc5-ad26-c9fca0e7559f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146173 Oct 19 22:25:05.409729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1748/3483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:05.442208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:05.442824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:05.450065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:05.450554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:05.451024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:05.451718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:05.452177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:05.452603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:05.579450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:05.588011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:05.589440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:05.590589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1a45aae2-f569-419b-ac51-a288094ea70a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152292 Oct 19 22:25:05.591169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1736/3484] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:06.053620 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:06.054296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:06.061221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.061698 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.062130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.062809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.063280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.063701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.108808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:06.109426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:06.115227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.115712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.116151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.116844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.117300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.117726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.129807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:06.137999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-97b546f0-fed8-4c0b-9e7e-905291cbab0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088442 Oct 19 22:25:06.138562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1749/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:06.245374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:06.253420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c8da0eb0-f228-4a0b-b71e-793edc2753d3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148441 Oct 19 22:25:06.253982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1737/3486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:06.432148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:06.432686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:06.438679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.439197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.439634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.440316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.440766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.441189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.564753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:06.573569 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ae4ccc81-14a9-4a33-a28e-8510e3100f63 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145336 Oct 19 22:25:06.574132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1750/3487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:06.615758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:06.616364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:06.622641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.623151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.623586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.624260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:06.624710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:06.625124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:06.750412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:06.759458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:06.760905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:06.762097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-45463767-579c-4970-b1ca-9c7d9288ad5d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150197 Oct 19 22:25:06.762655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1738/3488] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:07.161381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:07.161965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:07.168346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.168821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.169252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.169929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.170377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.170821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.231547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:07.239549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0f8692dd-7c79-4725-9570-951713205628 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082163 Oct 19 22:25:07.240128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1751/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:07.276163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:07.276776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:07.282623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.283140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.283567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.284243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.284688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.285106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.418822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:07.426834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-afcbf13b-33c1-42b8-84dd-d83279f94978 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154575 Oct 19 22:25:07.427418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1739/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:07 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:07.596156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:07.596760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:07.603525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.604006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.604438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.605117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.605564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.605981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.734683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:07.742794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3acb7d20-07e0-4a84-84a3-f00f8ba1f0b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150511 Oct 19 22:25:07.743380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1752/3491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:07.787842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:07.789323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:07.797804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.798324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.798773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.799510 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:07.799970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:07.800399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:07.928176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:07.936887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:07.938252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:07.939455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e1168a6a-ab7d-40e6-b1fa-a89a6b8f2416 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155683 Oct 19 22:25:07.940033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1740/3492] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:07 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:08.262101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:08.262713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:08.269254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.269735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.270170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:08.270855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.271334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.271764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:08.332546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:08.341285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1fc263af-f0cd-40ff-a3eb-150543e92c99 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083112 Oct 19 22:25:08.341852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1753/3493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:08.449681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:08.450303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:08.456824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.457308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.457748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:08.458444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.458903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.459342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:08.588605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:08.596673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6f944e5a-727f-448c-8af3-6a17b6486d7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151098 Oct 19 22:25:08.597238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1741/3494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:08.765105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:08.765726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:08.771624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.772109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.773194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:08.773882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.774349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.774774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:08.899028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:08.907107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-20691997-0e1b-4527-855b-799866b67d1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145804 Oct 19 22:25:08.907672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1754/3495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:08.965924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:08.973232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:08.973232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.973515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.973953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:08.974641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:08.975128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:08.975594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:09.101919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:09.110297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:09.111801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:09.112960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-445ceca0-f626-4664-8306-656650b97fb3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150970 Oct 19 22:25:09.113518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1742/3496] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:09.364532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:09.365102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:09.372036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:09.372567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:09.373006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:09.373693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:09.374146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:09.374571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:09.437677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:09.446448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab7e72ff-3d5b-4e7a-a4ce-6cdfcd41e7c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085839 Oct 19 22:25:09.447028 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1755/3497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:09.620867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:09.621414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:09.627385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:09.627861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:09.628288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:09.628965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:09.629414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:09.629833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:09.753177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:09.755362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:09.761864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-87cb45f2-d71e-4cb5-bcb5-9f472f3da6f7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145525 Oct 19 22:25:09.762423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1743/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:09.930111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:09.930633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:09.936610 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:09.937087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:09.937521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:09.938195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:09.938642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:09.939089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:10.063794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:10.072401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a4d59ebc-7108-4b9d-87e1-8d74a6b130c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146689 Oct 19 22:25:10.073213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1756/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:10.138778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:10.139479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:10.146217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:10.146767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:10.147169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:10.147860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:10.148313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:10.148736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:10.280192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:10.289203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:10.290644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:10.291845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a73ead54-1f74-49ab-b08b-ebd21f225ec1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157098 Oct 19 22:25:10.292402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1744/3500] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:10.469019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:10.469622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:10.476525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:10.477001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:10.477438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:10.478113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:10.478558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:10.478994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:10.540314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:10.548297 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-835936f8-dec8-483e-96a2-88e03366a676 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083233 Oct 19 22:25:10.548853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1757/3501] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:10.794144 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:10.794757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:10.800799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:10.801276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:10.801707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:10.802391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:10.802839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:10.803285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:10.928193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:10.936311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f260e453-41a3-48cf-b22f-21b1cf3757c4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146010 Oct 19 22:25:10.936875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1745/3502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:11.095875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:11.096447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:11.102333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.102815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.103288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:11.103973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.104423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.104844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:11.230453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:11.238545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6bf81082-b549-4e56-b8dc-bd46dcabd6eb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146640 Oct 19 22:25:11.239126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1758/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:11 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:11.317297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:11.317903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:11.324980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.325465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.325897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:11.326584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.327067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.327493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:11.456386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:11.464818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:11.466255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:11.467444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fd09b55a-26f1-4c4e-b6a0-c9a6b792b5d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154065 Oct 19 22:25:11.468001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1746/3504] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:11.571817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:11.572426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:11.579041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.579519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.579948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:11.580634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.581080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.581495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:11.645989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:11.654093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a5c53873-0140-49ad-ad82-876887c35554 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086754 Oct 19 22:25:11.654594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1759/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:11.959317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:11.959932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:11.965811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.966292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.966728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:11.967434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:11.967886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:11.968310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:12.094488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:12.103186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2158486a-4937-4136-9ee4-237461668606 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147645 Oct 19 22:25:12.103758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1747/3506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:12.261593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:12.262189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:12.268162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:12.268640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:12.269073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:12.269746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:12.270193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:12.270615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:12.273671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:12.396418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:12.405024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d28302d8-4921-4cc9-a2c1-614e3b197a07 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147421 Oct 19 22:25:12.405587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1760/3507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:12.492649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:12.493291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:12.499626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:12.500106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:12.500541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:12.501252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:12.501705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:12.502128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:12.626319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:12.635295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:12.636759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:12.637911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cea8f67c-d2e7-4ca0-ad1e-19cddb1d57fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149143 Oct 19 22:25:12.638470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1748/3508] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:12.675937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:12.677470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:12.683046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:12.683533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:12.683963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:12.684640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:12.685088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:12.685508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:12.748315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:12.756477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8bea807a-62e0-4dc3-ac4a-1af8bf338259 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084674 Oct 19 22:25:12.757551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1761/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:13.126313 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:13.126928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:13.132894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.133379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.133815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.134500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.134970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.135404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.264506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:13.273247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d5bf015d-5caa-4194-8931-8eb5d1b3238a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150195 Oct 19 22:25:13.273804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1749/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:13.429076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:13.429634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:13.435532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.436014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.436450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.437137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.437586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.438009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.663888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:13.664492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:13.671093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.671578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.672016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.672711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.673161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.673585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.782974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:13.794226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8aa421da-d328-42e2-b3f8-8e5ca3b731ab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.368936 Oct 19 22:25:13.805840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:13.806052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1762/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:13.811169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:13.811786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:13.814890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:13.816358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:13.817581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c50fdc8c-0cda-41fa-a6e6-5d592b9aa0d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157694 Oct 19 22:25:13.817841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.818249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1750/3512] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:13.818396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.818752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.821241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:13.821241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:13.821241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:13.889500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:13.897594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bfe2cd7c-8e0c-4b83-8404-aa8bc1a5fdf4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.090219 Oct 19 22:25:13.898151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1763/3513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:13 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:14.295196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:14.295789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:14.301662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.302138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.302572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.303271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.304342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.304759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.433564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:14.441677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed69f74a-9f4d-4fbe-8916-725e7d37ae58 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150309 Oct 19 22:25:14.442236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1751/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:14 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:14.818490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:14.819128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:14.826245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.826725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.827195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.827880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.828330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.828753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.849176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:14.849821 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:14.856098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.856584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.857024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.857712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.858177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.858605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.959242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:14.967958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ceee35a4-60f1-424d-8118-179fd716b90d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153240 Oct 19 22:25:14.968538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1764/3515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:14.972942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:14.973537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:14.979238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.979729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.980170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.980860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:14.981318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:14.981740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:14.988728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:14.997241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:14.998666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:14.999891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0f07fffb-45c8-43c4-9855-9adf8fd5a54d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154625 Oct 19 22:25:15.000458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1752/3516] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:14 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:15.042101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:15.050309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b3e2a87a-661e-4466-8222-2e7c0df5c8b9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.080815 Oct 19 22:25:15.050879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1765/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:15.465008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:15.465613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:15.471478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:15.471951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:15.472382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:15.473055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:15.473507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:15.473925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:15.606222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:15.614367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dbe371a9-9a48-47ea-95ce-7ab10417ca44 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153506 Oct 19 22:25:15.614934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1753/3518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:15.991539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:15.992149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:15.998527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:15.999037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:15.999477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.000164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:16.000617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:16.001042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.025214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:16.025910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:16.032231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:16.032731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:16.033164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.033844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:16.034291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:16.034707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.128599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:16.136982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5f435385-3f17-4adb-b1cb-a8a12941de30 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149290 Oct 19 22:25:16.137565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1766/3519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:16.141945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:16.142561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:16.148928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:16.149420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:16.149859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.150557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:16.151343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:16.151776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.165917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:16.174267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:16.175763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:16.176911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5203bdad-257f-43b0-941b-8cdf2d645280 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156092 Oct 19 22:25:16.177465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1754/3520] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:16.215173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:16.223376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-efe47fe8-a6ec-476d-9618-c44a1546e478 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084846 Oct 19 22:25:16.223936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1767/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:16.638467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:16.639106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:16.644984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:16.645459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:16.645890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.646564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:16.647047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:16.647464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:16.771167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:16.779126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6fd75800-5052-4481-9050-c2502d3984b0 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.144493 Oct 19 22:25:16.779680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1755/3522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:17.161265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:17.161875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:17.168778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.169257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.169691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.170370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.170820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.171268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.202759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:17.203396 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:17.209837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.210317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.210757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.211477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.211934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.212362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.297673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:17.306505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b5cc9bcb-db02-484f-9b28-e2b8bad8f0ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149185 Oct 19 22:25:17.307467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1768/3523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:17.311988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:17.312595 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:17.318607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.319120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.319580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.320270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.320863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.321287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.348478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:17.357746 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:17.359196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:17.360368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-03c36235-23c4-430d-a6ab-e423abc245e0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161783 Oct 19 22:25:17.360926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1756/3524] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:17.385291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:17.393438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-81d5dbf2-0b7a-406c-9df2-65cb0e9c8d14 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084947 Oct 19 22:25:17.397275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1769/3525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:17.801583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:17.802196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:17.808767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.809246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.814207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.814207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:17.814207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:17.814207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:17.937408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:17.945557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9e531862-4eb0-42bc-9a82-093bdcd15173 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147829 Oct 19 22:25:17.946119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1757/3526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:18.329938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:18.330483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:18.337587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.338087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.338511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:18.339223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.339679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.340104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:18.386055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:18.386661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:18.393270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.393787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.395656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:18.395656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.395656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.396014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:18.473486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:18.482723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6503342d-2c8f-4fac-912d-8469319c7f70 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.156778 Oct 19 22:25:18.483438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1770/3527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:18 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:18.487893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:18.488497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:18.494542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.495155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.495607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:18.496286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.496736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.497157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:18.545618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:18.554189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:18.555875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:18.556969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8bd259e-4e18-4c53-9b57-dbaa5e7002d1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.174819 Oct 19 22:25:18.558039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1758/3528] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:18.578673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:18.591041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3090effd-8deb-4ffc-9d19-b18aa457f44b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.103147 Oct 19 22:25:18.591041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1771/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:18.968873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:18.969485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:18.975410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.975887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.976317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:18.976995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:18.977439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:18.977857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:19.109515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:19.118186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b0000665-23eb-4c37-aecd-dfd5975b7420 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153242 Oct 19 22:25:19.118751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1759/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:19.506181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:19.506822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:19.512968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:19.513450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:19.513889 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:19.514573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:19.515057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:19.515487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:19.583719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:19.584321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:19.591353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:19.591831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:19.592286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:19.592967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:19.593414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:19.593989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:19.611024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:19.643914 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:19.662481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-be5568fc-fbc2-4d1f-9559-664879df051a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.159573 Oct 19 22:25:19.663768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1772/3531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:19.668397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:19.669007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:19.674996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:19.675500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:19.675943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:19.676634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:19.677091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:19.677513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:19.729794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:19.738490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:19.739946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:19.741171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6cb88870-e4d6-4465-bc12-67845657cad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161336 Oct 19 22:25:19.741325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:19.741735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1760/3532] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:19.749582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-266e42e2-b814-4931-b126-fb47e8160f57 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084849 Oct 19 22:25:19.750134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1773/3533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:20.142265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:20.142854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:20.148910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.149388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.149824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.150502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.150971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.151398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.281354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:20.289975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1380e906-8d99-4f6b-940a-5bc769e6afed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152038 Oct 19 22:25:20.290536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1761/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:20 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:20.686675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:20.687315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:20.693718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.694225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.694658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.695356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.695947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.696370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.765724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:20.766331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:20.772246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.773328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.773975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.774449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.775044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.775340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.825511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:20.833660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e7dc1511-a6d6-4c40-99a3-4487ea9d4a8c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150832 Oct 19 22:25:20.834234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1774/3535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:20.839476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:20.840303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:20.845924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.846414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.846879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.847593 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:20.848045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:20.848519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:20.905304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:20.910101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:20.914053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:20.915635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:20.916955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-00a08fd7-24a8-4653-91bd-ccb5a0eb011a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155217 Oct 19 22:25:20.917518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1762/3536] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:20 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:20.918242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-33e72850-c568-4a20-815d-7928ad3a96ea tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083076 Oct 19 22:25:20.918804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1775/3537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:20 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:21.313247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:21.313857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:21.320881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:21.321360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:21.321797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:21.322481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:21.323248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:21.323673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:21.451955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:21.460050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3a90e652-ceb5-47db-ae09-1999c05fe91a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150670 Oct 19 22:25:21.460609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1763/3538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:21.857567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:21.858164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:21.864525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:21.865013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:21.865442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:21.866115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:21.866562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:21.866995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:21.941556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:21.942497 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:21.948423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:21.948911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:21.949339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:21.950088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:21.950542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:21.950976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:21.996876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:21.999197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:22.005854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-97e1a6a5-362e-4da2-b917-b52e984e04ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152091 Oct 19 22:25:22.006677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1776/3539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:22.021790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:22.021790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:22.022075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:22.022209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:22.022209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:22.022209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:22.022209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:22.023174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:22.023174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:22.023356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-24b8060c-62df-4f55-8f47-bd99eac326e2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082622 Oct 19 22:25:22.023356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1764/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:22.146856 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:22.156214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:22.157637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:22.158786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b2de2984-df6e-498b-9aa2-5793d19a2ad9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151462 Oct 19 22:25:22.159383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1777/3541] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:22.482820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:22.483456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:22.489837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:22.490320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:22.490750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:22.491466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:22.491920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:22.492341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:22.618082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:22.626207 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ac83c38f-51f6-4d80-a02f-8e36c5c37ef9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147300 Oct 19 22:25:22.626794 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1765/3542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:23.029362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:23.029972 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:23.036336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.036814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.037249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.038532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.038938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.039695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.044003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:23.044623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:23.050455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.050941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.051408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.052096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.052552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.052980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.117169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:23.125477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d8df0ba6-0195-4816-8dd0-e1fd10e8bed2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085284 Oct 19 22:25:23.126051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1766/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:23.167038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:23.175282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-da8feda8-ddbc-44fd-b36c-67e1b7cba259 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149862 Oct 19 22:25:23.175849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1778/3544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:23.184494 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:23.185110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:23.191039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.191528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.191969 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.192660 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.193117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.193547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.319067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:23.327985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:23.329412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:23.330551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cc464c96-3696-4fec-9750-c25ea2f3337e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150007 Oct 19 22:25:23.331136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1767/3545] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:23.650647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:23.651279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:23.657068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.657540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.657969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.658646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:23.659125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:23.659540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:23.808945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:23.818370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cb896724-9f1b-482d-8d05-a11ea529e15c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.172017 Oct 19 22:25:23.829054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1779/3546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:24.147237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:24.147773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:24.154280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.154756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.155225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.155911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.156373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.156780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.200470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:24.201084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:24.207940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.208715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.209149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.209988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.210434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.210850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.222367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:24.232640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-196183ea-9ec3-4ebf-9773-d5d7218c94e6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089411 Oct 19 22:25:24.233238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1768/3547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:24.347089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:24.355982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-86124a6f-3e02-4b0d-981b-d4f335d5ebdf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.159891 Oct 19 22:25:24.356756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:24.356912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1780/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:24.357251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:24.363548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.364036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.364475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.365170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.365621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.366618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.502147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:24.511303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:24.512740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:24.513897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-978d25ca-c4cf-4990-b7c0-345081ce0968 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161423 Oct 19 22:25:24.514455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1769/3549] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:24.843666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:24.844277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:24.850151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.850626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.851088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.851773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:24.852223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:24.852644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:24.980627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:24.988720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c04c0881-9532-4741-a127-7d746f469449 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148926 Oct 19 22:25:24.989284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1781/3550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:25.255050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:25.255658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:25.262591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:25.263120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:25.263564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:25.264260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:25.264721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:25.265152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:25.325898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:25.333908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7e16a53f-2d21-4280-aba3-f098cfce43e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082811 Oct 19 22:25:25.334457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1770/3551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:25.379616 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:25.380225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:25.387077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:25.387560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:25.387997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:25.388679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:25.389129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:25.389556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:25.515405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:25.524237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ea04f86a-2b5d-4bd1-ad86-f1ca799ebe13 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148466 Oct 19 22:25:25.524799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1782/3552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:25 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:25.539477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:25.540096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:25.546090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:25.546551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:25.547007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:25.547694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:25.548142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:25.548564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:25.674109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:25.687226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:25.688719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:25.689918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-38f4a223-c682-4c13-893f-73814330c449 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154460 Oct 19 22:25:25.690472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1771/3553] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:26.011948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:26.012559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:26.018511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.019038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.019479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.020163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.020615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.021036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.149567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:26.157798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8ebcbba8-f500-4fce-a6fa-4a734b4f2bfd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149739 Oct 19 22:25:26.158363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1783/3554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:26 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:26.357555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:26.358111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:26.364444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.364928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.365362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.366084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.366538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.366983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.430282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:26.438401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-02644a14-0484-4842-b88e-c431e546f4e3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084807 Oct 19 22:25:26.438970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1772/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:26.556265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:26.556875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:26.563383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.563864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.564300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.564986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.565438 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.565861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.690269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:26.698575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7c620830-bf6a-4d5e-b2e0-7dfaa5680dda tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145864 Oct 19 22:25:26.703127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1784/3556] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:26.716815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:26.717421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:26.723476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.723952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.724380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.725058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:26.726131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:26.726536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:26.851875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:26.860258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:26.861684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:26.862826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2afc0568-872c-46c6-95ac-e80e12ae12d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149905 Oct 19 22:25:26.863406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1773/3557] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:26 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:27.181612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:27.182213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:27.188104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.188578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.189006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:27.189683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.190149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.190596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:27.315165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:27.324102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-15ce07c2-b82b-4c80-87b6-6cfc8ed29a67 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146853 Oct 19 22:25:27.324661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1785/3558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:27.461035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:27.461762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:27.468085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.468565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.468996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:27.469676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.470123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.470545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:27.531546 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:27.540359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2d12bef6-cedc-408e-9184-a366f8044c34 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083250 Oct 19 22:25:27.540917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1774/3559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:27.724920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:27.725973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:27.732382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.732868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.733306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:27.733993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.734447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.734875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:27.866435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:27.874536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6f819cba-f9df-41c9-8b15-8533eeef7bc4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153532 Oct 19 22:25:27.875128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1786/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:27.895709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:27.896352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:27.903098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.903585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.904064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:27.904749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:27.905196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:27.905616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:28.033968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:28.043528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:28.045113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:28.046271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f517ffce-a940-4fa5-bd50-e6e96b06a3d3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.160141 Oct 19 22:25:28.047164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1775/3561] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:28.346804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:28.347353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:28.349288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:28.354458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:28.354943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:28.355479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:28.356164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:28.356615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:28.357033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:28.483817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:28.492563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-715b138b-8950-4f8e-b1e0-fca991061c85 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149725 Oct 19 22:25:28.493128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1787/3562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:28.563847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:28.564457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:28.566849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:28.571838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:28.572316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:28.572747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:28.573729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:28.578630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:28.578630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:28.637928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:28.646056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4fb6d791-e408-4184-896b-b3d975747bd6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086008 Oct 19 22:25:28.646619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1776/3563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:28 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:28.902151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:28.902737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:28.909147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:28.909631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:28.910074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:28.910761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:28.911241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:28.911666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:29.042043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:29.050335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-50dd9406-7de8-477c-a8fb-0694824e9869 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152179 Oct 19 22:25:29.050904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1788/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:29.076903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:29.077506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:29.083401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:29.083874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:29.087679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:29.087679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:29.087679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:29.087679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:29.090403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:29.212512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:29.220995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:29.222433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:29.223620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9e662faf-2999-4391-a06c-4162bf027a2d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150905 Oct 19 22:25:29.224170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1777/3565] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:29.515375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:29.515988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:29.521962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:29.522447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:29.522888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:29.523701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:29.524268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:29.524702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:29.650935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:29.659102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b7589fd6-59d4-4af1-b4c6-436455d2b43f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147565 Oct 19 22:25:29.659663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1789/3566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:29.668488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:29.669232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:29.675633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:29.676120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:29.676561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:29.677253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:29.677712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:29.678142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:29.743815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:29.752213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-08cc3047-fc33-48fc-b626-18f3c6b7e6e5 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087524 Oct 19 22:25:29.752784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1778/3567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:30.074326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:30.074879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:30.081342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.081848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.082269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.082982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.083507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.083936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.212328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:30.220703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-643ed705-4baa-4e14-94fb-e765ad5dcd91 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150617 Oct 19 22:25:30.221275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1790/3568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:30.247964 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:30.248575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:30.254520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.255033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.255470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.256152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.257208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.257639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.383398 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:30.391815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:30.393244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:30.394388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3a73bc0c-c82f-4f3f-8831-a78c885e483a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150277 Oct 19 22:25:30.394946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1779/3569] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:30.681911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:30.682441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:30.688680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.689161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.689596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.690277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.690726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.691173 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.775231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:30.775852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:30.781879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.782372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.782815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.783535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:30.783997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:30.784424 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:30.822320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:30.830770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-64b8e6d1-327d-4f6f-9feb-3fe707ff15ed tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152751 Oct 19 22:25:30.831364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1791/3570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:30.846565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:30.854862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-02ef6fd6-b226-4bf4-ae30-b5ec6819cc98 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084037 Oct 19 22:25:30.855444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1780/3571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:31.244386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:31.245061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:31.251382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.251857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.252287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.252962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.253405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.253820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.379506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:31.387547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ef229ad7-56b1-4fc5-8ee9-0174e94173cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147631 Oct 19 22:25:31.388112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1792/3572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:31.419891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:31.420505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:31.426466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.427003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.427490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.428177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.429482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.429947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.559726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:31.568283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:31.569715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:31.570863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d0eca6ea-973b-45e0-b438-0aa578e0f6a9 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154874 Oct 19 22:25:31.571455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1781/3573] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:31.854089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:31.854694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:31.860508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.860985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.861416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.862086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.862530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.862943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.877439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:31.877999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:31.878802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:31.885210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.889861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.889861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.889861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:31.889861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:31.890263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:31.966826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:31.975140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-71f194ad-6d17-4056-97cf-68b24757214b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.101422 Oct 19 22:25:31.976527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1782/3574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:32.016966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:32.025611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-26013912-6db6-48e0-bf67-f8150bee5bb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.175936 Oct 19 22:25:32.027142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1793/3575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:32.409800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:32.410346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:32.416299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:32.416785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:32.417225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:32.417911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:32.418365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:32.418791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:32.545522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:32.554178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3383d42a-2490-47f8-8331-7bc8d093eb5b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147856 Oct 19 22:25:32.554738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1783/3576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:32 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:32.596504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:32.597132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:32.603577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:32.604051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:32.604481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:32.605159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:32.605602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:32.606019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:32.731353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:32.739803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:32.741829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:32.742988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2b81044e-58e4-4984-b99b-50504b4a2945 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150401 Oct 19 22:25:32.743545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1794/3577] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:32.998533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:32.999179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:33.005540 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.006023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.006462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.007180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.007635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.008061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.048277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:33.048977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:33.055496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.055976 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.056406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.057092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.057549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.057964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.072415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:33.080785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4b8c3d9a-4dbb-4880-ad83-32806c4c244c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086055 Oct 19 22:25:33.081353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1784/3578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:33.187815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:33.195992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4559ea59-582b-4fc4-a49c-a6a3feff0811 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.151498 Oct 19 22:25:33.196551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1795/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:33 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:33.577722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:33.578330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:33.584358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.585472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.585900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.586571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.587047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.587463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.710812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:33.718895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8637d96f-888d-4747-9a7e-48147c430b75 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145014 Oct 19 22:25:33.719488 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1785/3580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:33.767641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:33.768252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:33.775302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.775785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.776223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.776907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:33.777371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:33.777796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:33.904473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:33.912995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:33.914432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:33.915619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d4722de-b574-4a12-bd94-43f17bec09d7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151963 Oct 19 22:25:33.916184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1796/3581] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:33 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:34.103760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:34.104369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:34.110712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.111157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.111591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:34.112295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.112743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.113161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:34.173151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:34.181835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9886115d-592d-4442-928b-7ae17bff37bb tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081971 Oct 19 22:25:34.182377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1786/3582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:34.219793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:34.220386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:34.226830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.227353 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.227787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:34.228473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.228919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.229337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:34.354635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:34.362658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-76a1046d-718a-46cb-b328-0a90f2a6bd2e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146682 Oct 19 22:25:34.363192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1797/3583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:34.742184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:34.742793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:34.748773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.749254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.749686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:34.750387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.750823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.751273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:34.879567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:34.888344 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-811aa9dd-c4b2-473e-a205-c8ee57a54ecb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150598 Oct 19 22:25:34.888905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1787/3584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:34.941268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:34.941879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:34.949172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.949654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.950097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:34.950782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:34.951266 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:34.951693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:35.080100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:35.088599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:35.090046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:35.091232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2d4265cc-94ec-4d3a-a705-bee31a53bdc8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153876 Oct 19 22:25:35.091795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1798/3585] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:35.206128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:35.206741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:35.213667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:35.214151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:35.214581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:35.215291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:35.215741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:35.216160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:35.276475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:35.284603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2e5b6d3f-aeeb-43f5-a888-677c5f3d145e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082243 Oct 19 22:25:35.285097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1788/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:35.386036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:35.386636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:35.392537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:35.393010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:35.393446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:35.394115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:35.394560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:35.395208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:35.519482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:35.528308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-340df4b1-0066-48cb-9be5-39ab76932b51 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146119 Oct 19 22:25:35.528869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1799/3587] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:35.911473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:35.912073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:35.918167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:35.918653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:35.919161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:35.919898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:35.920352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:35.920777 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:36.044667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:36.052716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0b455608-3ed7-4290-9758-713e692adeab tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145014 Oct 19 22:25:36.053311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1789/3588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:36.117155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:36.117773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:36.124265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:36.124754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:36.125199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:36.125890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:36.126349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:36.126786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:36.255011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:36.264081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:36.265527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:36.266685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0dc82ab1-9394-406a-b7d3-ee3be2869795 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154077 Oct 19 22:25:36.267284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1800/3589] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:36.308283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:36.308850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:36.315155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:36.315633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:36.316071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:36.316745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:36.317193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:36.317613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:36.383423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:36.391474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b906360c-8f5d-48b1-8a4d-20fe631e591c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087131 Oct 19 22:25:36.392027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1790/3590] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:36.551958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:36.552652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:36.559292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:36.559715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:36.560154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:36.560842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:36.561301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:36.561727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:36.685656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:36.693639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3f033054-8293-4f04-b01f-e2578a8e44cb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145522 Oct 19 22:25:36.694193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1801/3591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:37.075914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:37.076523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:37.082413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.082887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.083346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.084025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.084470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.085426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.209548 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:37.218669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-23537819-956d-417f-b37f-7577b3a71f8f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146894 Oct 19 22:25:37.219255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1791/3592] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:37.292240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:37.292836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:37.299195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.299673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.300122 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.300803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.301248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.301668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.413599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:37.414528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:37.420839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.421325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.421760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.422448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.422900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.423352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.428576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:37.437089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:37.438517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:37.439694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-18d78dd4-c98d-4d84-bceb-85933897d8f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151321 Oct 19 22:25:37.440253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1802/3593] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:37.484602 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:37.492561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b8798fee-b25d-4346-a427-13d1a25508d6 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082842 Oct 19 22:25:37.493117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1792/3594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:37.716546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:37.717156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:37.723074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.723561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.723998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.724679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:37.725128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:37.725548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:37.858980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:37.867720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-28d8a538-fc68-4e15-8170-da3e6407a988 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154965 Oct 19 22:25:37.868310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1803/3595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:38.242832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:38.243485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:38.249363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.249838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.250264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:38.250942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.251416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.251836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:38.379338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:38.381491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:38.387970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-974e0384-b7e2-41cd-9fe6-a42f2e18838a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149684 Oct 19 22:25:38.391088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1793/3596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:38 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:38.466226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:38.466859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:38.473505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.474066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.474496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:38.475228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.476311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.476732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:38.515291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:38.516012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:38.523371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.523870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.531044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:38.531044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.531044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.531044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:38.588883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:38.597081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-35571246-2212-49d3-aeee-6fee5ad92617 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085573 Oct 19 22:25:38.597937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1794/3597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:38.615743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:38.624481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:38.625931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:38.627227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-37933a4b-5f29-47b0-8573-698c025ce8cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.165040 Oct 19 22:25:38.627739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1804/3598] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:38.891454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:38.892008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:38.898690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.899218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.899664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:38.900358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:38.900823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:38.901250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:39.025186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:39.033185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ca12d2d8-a093-4b4c-aeb8-d262be964ca7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145710 Oct 19 22:25:39.033751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1795/3599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:39.412881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:39.413538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:39.419632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:39.420144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:39.420604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:39.421300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:39.421757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:39.422182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:39.553276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:39.562164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2529c681-6f40-4d1a-b781-96442ea32591 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153140 Oct 19 22:25:39.562739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1805/3600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:39.622537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:39.623514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:39.630058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:39.630544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:39.631000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:39.632242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:39.632698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:39.633124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:39.653128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:39.653851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:39.659778 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:39.660256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:39.660694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:39.661384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:39.661822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:39.662238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:39.709276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:39.718403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9ed336e7-0722-4146-883a-2e1e15d68f0f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.101323 Oct 19 22:25:39.719007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1796/3601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:39 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:39.799686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:39.808229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:39.809646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:39.810790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ce679ab9-fbb6-4fd0-b7ed-1ca7389f022f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.161744 Oct 19 22:25:39.811412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1806/3602] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:39 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:40.056930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:40.057458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:40.063507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.063984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.064414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.065283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.065740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.066157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.198578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:40.207037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-df4c75f8-97c3-4cb9-9195-08d22ab1aaf5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154633 Oct 19 22:25:40.207613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1797/3603] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:40 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:40.586116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:40.586725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:40.593164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.593636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.594068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.594744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.595221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.595637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.723997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:40.732739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-063dcaab-43a6-40f6-954f-62466cd96849 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150949 Oct 19 22:25:40.733313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1807/3604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:40.740641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:40.741838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:40.748731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.749232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.749678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.750376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.750839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.751306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.814699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:40.822849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b2782038-99b7-4ac3-a9cb-8357f720404f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086060 Oct 19 22:25:40.823707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1798/3605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:40 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:40.838120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:40.838665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:40.844597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.845082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.845521 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.846202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:40.846656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:40.847114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:40.973272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:40.982339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:40.983804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:40.984958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cf5a06af-223e-4243-a865-ee5538e4f76c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151344 Oct 19 22:25:40.985507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1808/3606] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:41.229606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:41.230226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:41.236260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:41.236741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:41.237169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:41.237850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:41.238298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:41.238716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:41.367084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:41.375204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d0d88a74-9104-4bc1-8e29-b463c2284e95 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149452 Oct 19 22:25:41.375771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1799/3607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:41 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:41.756195 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:41.756797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:41.763187 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:41.763667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:41.764095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:41.764772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:41.765214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:41.765631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:41.845543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:41.846147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:41.852573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:41.853037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:41.853476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:41.854165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:41.854614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:41.855057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:41.892434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:41.901210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d45867f8-a1a8-462d-920a-da9771a32f7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148894 Oct 19 22:25:41.901767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1809/3608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:41.917663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:41.926002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bedcb01b-4606-4b7c-929a-d67771534fda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084304 Oct 19 22:25:41.926555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1800/3609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:41 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:42.010602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:42.011170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:42.017003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.017488 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.017924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:42.018678 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.019194 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.019622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:42.024120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:42.148513 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:42.156954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:42.158377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:42.159550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-03f40aad-f293-4998-86e3-be74023e9b34 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153412 Oct 19 22:25:42.160103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1810/3610] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:42.398169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:42.398775 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:42.404789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.405260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.405687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:42.406359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.406804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.407303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:42.531472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:42.540088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0690b67d-ff82-4e8d-aeb0-23db8f62cb50 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145921 Oct 19 22:25:42.540652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1801/3611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:42 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:42.924493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:42.925098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:42.931584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.932057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.932483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:42.933153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.933598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.934013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:42.948556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:42.949254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:42.955511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.956001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.956446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:42.957124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:42.957574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:42.957997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:43.022679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:43.031012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1bdc774e-d3c2-4c9d-931c-28c2e7d2d972 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086466 Oct 19 22:25:43.031587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1802/3612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:42 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:43.061777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:43.069957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a33651d0-02fa-4898-875d-d7a33660c7cf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149344 Oct 19 22:25:43.070518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1811/3613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:42 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:43.184375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:43.184982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:43.191300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:43.191791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:43.192232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:43.192948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:43.193405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:43.193830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:43.318220 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:43.329638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:43.331107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:43.332289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f0a56287-dac2-40de-a427-6841fd5d7c70 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151795 Oct 19 22:25:43.332859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1803/3614] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:43 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:43.562572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:43.563244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:43.569672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:43.570083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:43.570517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:43.571226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:43.571681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:43.572103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:43.703200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:43.711224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-80c0ec1c-779e-4215-a571-0c24a7d31ce4 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152512 Oct 19 22:25:43.716805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1812/3615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:43 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:44.054097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:44.054700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:44.061228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.061707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.062143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.062823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.063335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.063756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.094208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:44.094908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:44.101459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.102025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.102463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.103203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.103638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.104057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.125404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:44.134057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-16f9a1b8-324f-4e0b-bbf2-d7461a59ab97 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083779 Oct 19 22:25:44.134626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1804/3616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:44.232016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:44.240207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-de5c150c-67c9-44a9-94d5-720f9e44b136 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150119 Oct 19 22:25:44.240808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1813/3617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:44 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:44.358096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:44.358700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:44.364635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.365116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.365550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.366744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.367219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.367641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.494909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:44.503512 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:44.504957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:44.506119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0ceb8b9c-d5b4-4f03-bb19-b2eda44d225f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152099 Oct 19 22:25:44.507317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1805/3618] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:44 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:44.733915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:44.734470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:44.740328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.740826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.741262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.741942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:44.742397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:44.742821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:44.866045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:44.874164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01f2ce65-6f55-4356-8be7-4c0683d7d6a9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.144182 Oct 19 22:25:44.874725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1814/3619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:44 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:45.157130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:45.157655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:45.163999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.164477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.164908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:45.165584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.166033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.166448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:45.228058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:45.236120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d9a6e8ee-729f-4c1b-9c68-6d47e27e85e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082890 Oct 19 22:25:45.236671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1806/3620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:45 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:45.269426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:45.270040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:45.276421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.276902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.277367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:45.278074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.278527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.278977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:45.405902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:45.414046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5828185e-2cfb-46e8-9294-2d1ad1bb5815 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148404 Oct 19 22:25:45.414552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1815/3621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:45 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:45.531943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:45.532547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:45.538895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.539401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.539831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:45.540509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.540955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.541375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:45.667840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:45.676339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:45.677780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:45.678937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c617dfd5-999a-4049-a0fc-1f2eb41d1c00 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150841 Oct 19 22:25:45.679513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1807/3622] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:45 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:45.897665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:45.898267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:45.904147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.904619 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.905050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:45.905723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:45.906171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:45.906589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:46.034477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:46.042746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-929622db-e98e-4199-a0df-f4b9572911a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149047 Oct 19 22:25:46.043347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1816/3623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:45 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:46.259056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:46.259613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:46.265976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:46.266453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:46.271758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:46.271758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:46.271758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:46.271758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:46.332924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:46.341151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b8e8a26e-6d5e-4ed1-94f3-888c80dbc114 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085979 Oct 19 22:25:46.341717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1808/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:46 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:46.437117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:46.437761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:46.444236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:46.444718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:46.445188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:46.445877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:46.446333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:46.446762 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:46.577222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:46.586006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d6fa8d95-06c0-456c-a4c7-d0f09206dd5a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152740 Oct 19 22:25:46.586600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1817/3625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:46 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:46.704812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:46.705423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:46.712019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:46.712508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:46.712944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:46.713658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:46.714141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:46.714568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:46.839514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:46.848029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:46.849476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:46.851293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6cfc2591-8083-4939-85b9-cfdb4dfe75aa tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150357 Oct 19 22:25:46.851853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1809/3626] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:46 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:47.065551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:47.066088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:47.072586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.073068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.073764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:47.074446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.074895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.075344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:47.199918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:47.207918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-55b71581-931c-4462-a28d-a99eea48861f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146250 Oct 19 22:25:47.208480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1818/3627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:47 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:47.364078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:47.364688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:47.372427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.372427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.372680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:47.373372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.373827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.374260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:47.389683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:47.436686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:47.443683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-adeeb99b-9e6a-4353-8810-d6cc0edf09ad tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083457 Oct 19 22:25:47.444809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1810/3628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:47 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:47.609638 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:47.610165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:47.616765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.617246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.617711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:47.618393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.618839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.619285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:47.747376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:47.755467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6c76161d-2f55-4d08-80d2-fc668bd23049 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149741 Oct 19 22:25:47.756066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1819/3629] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:47 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:47.876850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:47.877375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:47.884014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.884504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.884943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:47.885630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:47.886093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:47.886521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:48.018474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:48.027595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:48.029038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:48.030231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-43ea80e4-d5df-413a-b1c7-7e9d9b42a5ce tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157814 Oct 19 22:25:48.030795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1811/3630] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:47 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:48.230989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:48.231599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:48.237594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:48.238075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:48.238510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:48.239214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:48.239667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:48.240088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:48.367995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:48.376082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bec050a6-b91b-4d0a-85ef-20a00e84877b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148973 Oct 19 22:25:48.376636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1820/3631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:48 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:48.466375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:48.467032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:48.473356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:48.473833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:48.474263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:48.474937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:48.475919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:48.476448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:48.538491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:48.546744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-36f52703-c969-49aa-9ea4-64ad1623caaf tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084321 Oct 19 22:25:48.547399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1812/3632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:48 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:48.779329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:48.779922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:48.786306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:48.786721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:48.787184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:48.788384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:48.788833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:48.789461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:48.915325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:48.923627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c536e5c5-571a-4f50-ba9a-e42614e7572d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148014 Oct 19 22:25:48.924095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1821/3633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:49.055537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:49.056071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:49.062004 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.062485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.062923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:49.063632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.064084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.064505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:49.189386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:49.197852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:49.199606 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:49.200785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8b998f7c-273c-479c-b6ac-eabdd38880c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.149236 Oct 19 22:25:49.201362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1813/3634] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:49 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:49.399621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:49.400368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:49.406504 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.407007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.407440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:49.408117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.408565 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.408983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:49.537079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:49.545741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-efc56eaf-b87e-4ff8-bae0-7338fdc561eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150091 Oct 19 22:25:49.546302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1822/3635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:49 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:49.569765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:49.570682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:49.577610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.578094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.578532 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:49.579254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.579709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.580143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:49.645334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:49.653948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2c1c2a04-4c0e-4b6d-9d27-8f58e2a6ddd2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088299 Oct 19 22:25:49.654450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1814/3636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:49 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:49.947459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:49.948096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:49.954750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.955263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.955695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:49.956372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:49.956820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:49.957242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:50.082535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:50.091258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-785411df-8739-47cf-9075-3bbed795d47c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147504 Oct 19 22:25:50.092319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1823/3637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:49 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:50.226707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:50.227604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:50.233838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:50.234318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:50.234747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:50.235456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:50.235929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:50.236349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:50.361898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:50.370992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:50.372491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:50.373655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-13cff17c-3137-4793-9936-10ddcc9ee7f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151021 Oct 19 22:25:50.374215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1815/3638] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:50 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:50.569847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:50.570386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:50.576548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:50.577034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:50.577471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:50.578157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:50.578615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:50.579073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:50.677474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:50.678091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:50.684583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:50.685072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:50.685514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:50.686208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:50.686673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:50.687141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:50.706516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:50.714673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dc92d574-b960-402a-ae36-c4cfb98b6f4e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149360 Oct 19 22:25:50.715281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1824/3639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:50 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:50.750073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:50.758515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2e201bc8-c46e-4fae-af36-661543a4436a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084867 Oct 19 22:25:50.759101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1816/3640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:50 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:51.114404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:51.115069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:51.121440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.121919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.122350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.123055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.123503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.123926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.247548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:51.255512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ad8718e1-30dd-4d97-89cd-59a83127c534 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.144974 Oct 19 22:25:51.256068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1825/3641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:51 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:51.400188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:51.400723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:51.407066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.407545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.407975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.408654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.409099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.409514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.538498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:51.547065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:51.548533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:51.549680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6435daa6-7aa7-4fd7-b4c3-dd5d7caf8da8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153957 Oct 19 22:25:51.550233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1817/3642] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:51 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:51.738089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:51.738733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:51.744633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.745119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.745553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.746233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.746684 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.747134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.780759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:51.781402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:51.787627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.790196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.790653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.791871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:51.792989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:51.793908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:51.856622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:51.864807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3c2cb411-14b2-4d51-8284-126930034502 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087838 Oct 19 22:25:51.865383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1818/3643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:51 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:51.875113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:51.877330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:51.884460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-623b838b-0f6a-4c9c-adbf-78443d2f0a63 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150219 Oct 19 22:25:51.885018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1826/3644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:51 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:52.278839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:52.279482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:52.285408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.285889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.286324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.287038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.287490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.288439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.414323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:52.422474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19a8ee6d-15e3-4fef-b29b-9e9be8d12c9b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147521 Oct 19 22:25:52.423083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1819/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:52 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:52.575161 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:52.575788 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:52.582262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.582743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.583203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.583891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.584343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.585288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.713955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:52.722446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:52.723896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:52.725043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1925b367-04ed-410f-9853-299dce53b643 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154372 Oct 19 22:25:52.726233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1827/3646] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:52 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:52.887616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:52.888229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:52.894138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.894617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.895080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.895762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.896215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.896646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.909199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:52.909844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:52.916427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.916842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.917283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.917974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:52.918432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:52.918857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:52.962060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:52.970748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6427fb47-100c-4d7f-a4e7-0113e216d8d0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086998 Oct 19 22:25:52.971342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1820/3647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:52 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:53.046936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:53.055080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6bf66611-2e4a-48bd-8b86-e6fce01be61a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149704 Oct 19 22:25:53.055670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1828/3648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:52 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:53.445285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:53.445933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:53.452571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:53.453043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:53.453471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:53.454145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:53.454589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:53.455033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:53.585853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:53.593967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-de82c423-60a5-461e-bed0-86f67df7734a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152506 Oct 19 22:25:53.594536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1821/3649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:53 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:53.750847 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:53.751434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:53.758311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:53.758767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:53.759223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:53.759894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:53.760341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:53.760756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:53.891501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:53.900584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:53.902037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:53.903213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8baadf06-6ff2-4b73-a039-6ea8594380c4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156336 Oct 19 22:25:53.903795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1829/3650] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:53 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:53.993753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:53.994362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:54.002836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.003297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.003734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:54.004421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.004876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.005308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:54.065489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:54.074428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf2d0871-c8b8-43d5-b922-95d13cc8bcae tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084518 Oct 19 22:25:54.075176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1822/3651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:53 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:54.079421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:54.080117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:54.086913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.087497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.087928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:54.088609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.089054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.089470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:54.215604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:54.223669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-40be62eb-f13b-48cb-8254-9cfa6389dea1 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148879 Oct 19 22:25:54.224238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1830/3652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:54 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:54.617086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:54.617690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:54.625084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.625569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.626008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:54.626689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.627168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.627588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:54.756047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:54.764505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a59d0a0c-9dc0-4c0d-8afb-820b5b0db3ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151345 Oct 19 22:25:54.765066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1823/3653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:54 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:54.927822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:54.928871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:54.935328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.935810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.936245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:54.936927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:54.937378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:54.937802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:55.065062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:55.074324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:55.075783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:55.076962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-30a77eb0-ff5b-4168-aa70-70dbbe502ced tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153125 Oct 19 22:25:55.077516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1831/3654] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:54 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:55.097287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:55.097906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:55.103819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:55.104299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:55.104737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:55.105422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:55.105876 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:55.106301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:55.165406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:55.173357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bf09e1ad-ebc6-4d91-89f1-636db604c2e4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.079892 Oct 19 22:25:55.173917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1824/3655] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:55 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:55.248340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:55.248964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:55.254764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:55.255275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:55.255705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:55.256383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:55.256830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:55.257252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:55.381303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:55.389334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4367bdb-4cf5-4f75-b26a-4ad0d498c9e7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.144861 Oct 19 22:25:55.389893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1832/3656] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:55 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:55.788732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:55.789563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:55.795823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:55.796320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:55.796760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:55.797452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:55.797909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:55.798335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:55.924365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:55.932412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-60aaca78-1439-4b53-9e2b-637d73e0cc1a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148130 Oct 19 22:25:55.932973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1825/3657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:55 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:56.103183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:56.103796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:56.110179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.110658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.111130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.111814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.112268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.112695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.197403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:56.198117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:56.200297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:56.204990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.205470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.205907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.206583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.207051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.207471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.239564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:56.248295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:56.249751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:56.250915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-431451c2-5943-4b8a-8e5c-cfe90f1046b1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151741 Oct 19 22:25:56.251502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1833/3658] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:56 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:56.273089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:56.281107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2f543c47-410a-4414-8e53-e9ad6219da51 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.088355 Oct 19 22:25:56.281658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1826/3659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:56 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:56.411823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:56.412356 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:56.418223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.418699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.419184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.419862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.420319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.420736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.547626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:56.556186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8de37a2d-2263-47f6-bdfb-345ce993ea39 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148264 Oct 19 22:25:56.556728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1834/3660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:56 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:56.954919 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:56.955558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:56.961956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.962436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.962873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.963581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:56.964036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:56.964460 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:56.968331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:57.089611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:57.097820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1cf04fea-b3ab-4c7c-8126-5744a29387b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146706 Oct 19 22:25:57.098384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1827/3661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:56 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:57.276506 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:57.277138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:57.283572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:57.284053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:57.284485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:57.285160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:57.285605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:57.286021 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:57.304094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:57.304645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:57.310454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:57.310939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:57.311552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:57.312099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:57.312553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:57.312972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:57.374058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:57.382844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e4e8b5ac-7298-43ad-a82c-d5a970b26b42 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083030 Oct 19 22:25:57.383439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1828/3662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:57 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:25:57.415901 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:57.424385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:57.425807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:57.426971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9c030f9a-d9dc-46e9-8517-54d27052a8de tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154329 Oct 19 22:25:57.427524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1835/3663] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:57 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:57.579724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:57.580270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:57.586054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:57.586528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:57.586972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:57.587653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:57.588102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:57.588518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:57.717520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:57.725549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0e949d96-bcbb-46c0-bf02-6cb7f2e2201b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149685 Oct 19 22:25:57.726111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1829/3664] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:57 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:58.121343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:58.124942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:58.127884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.128361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.128793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.129472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.129921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.130338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.259026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:58.267087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-58867fb8-f736-4d6c-b18c-27f193424022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149637 Oct 19 22:25:58.267643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1836/3665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:58 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:58.404732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:58.405265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:58.411751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.412234 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.413183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.413866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.414318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.414965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.453254 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:58.453867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:58.456204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:25:58.460943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.461435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.461872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.462568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.463056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.463484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.478176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:58.486632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-785b0d95-c620-4e06-badb-37aa08758de8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085752 Oct 19 22:25:58.487365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1830/3666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:58 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:58.594683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:58.603888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:58.605319 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:58.606515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b42e1c3b-5200-4021-b2f5-1cffeedfc3b7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157104 Oct 19 22:25:58.607204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1837/3667] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:58 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:25:58.748200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:58.748837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:58.754621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.755195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.755628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.756349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:58.756798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:58.757217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:58.880013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:58.887932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3e332b7c-c3fb-4b0b-b682-b9ecb6c87dbe tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.143703 Oct 19 22:25:58.888834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1831/3668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:58 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:59.289932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:59.290540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:59.296645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.297076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.297509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:59.298191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.298647 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.299186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:59.423439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:59.432134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5457d82d-f540-4561-af9f-83bcd009ca50 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146129 Oct 19 22:25:59.432701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1838/3669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:59 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:59.509357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:59.509978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:59.516475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.516962 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.517405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:59.518089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.518547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.519009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:59.582299 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:59.590452 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5995e3e8-b4a7-4538-ab34-1b43ba7e21f0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085658 Oct 19 22:25:59.591033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1832/3670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:59 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:25:59.632312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:59.632915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:59.639285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.639770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.640205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:59.640888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.641340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.641766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:59.772801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:59.781390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:59.782823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:25:59.784124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-343c37a2-5b8e-4699-bc1d-21ca547154f0 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156268 Oct 19 22:25:59.784685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1839/3671] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:25:59 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:25:59.911555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:25:59.912067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:25:59.918062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.918553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.918979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:25:59.919666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:25:59.920110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:25:59.920530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:00.047762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:00.056112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6338ab37-a110-4cfb-91f3-aba3b3be4bd7 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.148405 Oct 19 22:26:00.056686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1833/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:25:59 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:00.455726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:00.456362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:00.462713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:00.463221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:00.463657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:00.464329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:00.464773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:00.465189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:00.590069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:00.598253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-92f1869a-4eab-4f05-b0c6-ec4213844e0b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146299 Oct 19 22:26:00.598814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1840/3673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:00 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:00.612762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:00.613380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:00.619767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:00.620253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:00.620693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:00.621385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:00.621840 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:00.622277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:00.682834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:00.690774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-99e3b0fe-18a0-4c8e-a217-318b51f0275e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081870 Oct 19 22:26:00.691376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1834/3674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:00 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:00.809844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:00.810451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:00.816909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:00.817395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:00.817835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:00.818526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:00.819542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:00.820001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:00.947853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:00.956624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:00.958066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:00.959280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ff560a6b-2164-425a-9e8b-10831907fb86 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153338 Oct 19 22:26:00.960383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1841/3675] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:00 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:01.078705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:01.079335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:01.085732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.086204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.086631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:01.087335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.087789 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.088206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:01.214389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:01.222343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-255a650d-a795-4b2e-b095-d88fc031d2ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147457 Oct 19 22:26:01.222903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1835/3676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:01 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:01.622598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:01.623311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:01.629750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.630233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.630664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:01.632146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.632600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.633111 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:01.764715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:01.769565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:01.770171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:01.773126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d898f502-1ec3-4284-8ddf-430d2dfa5ffa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154514 Oct 19 22:26:01.773702 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1842/3677] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:01 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:01.776435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.776913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.777343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:01.778063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.778529 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.778930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:01.840594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:01.848635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2ddfc079-3a72-4835-b17c-13487a56c947 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083014 Oct 19 22:26:01.849191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1836/3678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:01 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:01.985275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:01.985910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:01.992388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.992871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.993308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:01.993997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:01.994451 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:01.994876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:02.009957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:02.127723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:02.136739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:02.138178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:02.139359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a1ec1831-0caa-4564-be43-bcad95c1d5be tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157977 Oct 19 22:26:02.139917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1843/3679] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:01 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:02.245687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:02.246256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:02.252182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:02.252667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:02.253099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:02.253776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:02.254221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:02.254640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:02.383935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:02.392041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e64f5620-9ddf-4426-a074-a73d2a866e9d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150395 Oct 19 22:26:02.392605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1837/3680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:02 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:02.796497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:02.797109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:02.803077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:02.804228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:02.804663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:02.805352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:02.805803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:02.806227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:02.871707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:02.872316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:02.878619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:02.879143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:02.879579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:02.880267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:02.880721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:02.881295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:02.932242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:02.940467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1c0a3d67-b604-4ffa-b7e7-ef95390b9b0f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147828 Oct 19 22:26:02.941034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1844/3681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:02 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:02.947176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:02.955646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d496190d-091a-4d84-80a6-60718f72841b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087770 Oct 19 22:26:02.956203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1838/3682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:02 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:03.165725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:03.166264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:03.172705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.173185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.173621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:03.174303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.174753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.175201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:03.300529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:03.308949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:03.310394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:03.311572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d1e439b7-df15-4b84-a3b5-b7590b0fa0a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150430 Oct 19 22:26:03.312129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1845/3683] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:03 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:03.415820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:03.416367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:03.422321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.422805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.423284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:03.423976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.424430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.424856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:03.547696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:03.556304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2630216f-f1b0-4279-aba8-ba9fee139daf tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.145145 Oct 19 22:26:03.556865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1839/3684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:03 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:03.963759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:03.964374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:03.970330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.970818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.971289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:03.971985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.972450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.972871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:03.977485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:03.978171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:03.984709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.985190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.985621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:03.986303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:03.986749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:03.987193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:04.048364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:04.057078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-791266df-0927-4496-9945-13d2af2f4da3 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083289 Oct 19 22:26:04.057635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1840/3685] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:03 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:04.106162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:04.114425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9d789f4-5ed3-433b-b527-a2e77661e6ea tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154484 Oct 19 22:26:04.115009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1846/3686] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:03 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:04.337276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:04.337809 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:04.343769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:04.344248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:04.344680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:04.345450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:04.346019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:04.346446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:04.579668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:04.580257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:04.587390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:04.587830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:04.588265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:04.588966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:04.589418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:04.589841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:04.680503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:04.689054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:04.690503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:04.691973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b92b8d48-3484-41c4-9454-c71f5f6e1170 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.358952 Oct 19 22:26:04.692534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1841/3687] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:04 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:04.719268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:04.728262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-de3c9769-11e5-4f55-89d2-9deab624ff31 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152482 Oct 19 22:26:04.728829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1847/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:04 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:05.084757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:05.085370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:05.092390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.092877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.093317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.094005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.094464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.094891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.138861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:05.139533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:05.145446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.145931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.146362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.147083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.147570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.147989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.156214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:05.164440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c45d46be-874a-49b3-b568-9c2c4c5597c8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083558 Oct 19 22:26:05.165011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1842/3689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:05 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:05.276311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:05.284522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c08e41dc-a4fa-41c7-b0ce-eabaeb147e28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149722 Oct 19 22:26:05.285066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1848/3690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:05 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:05.717677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:05.718327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:05.724211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.724688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.725119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.725795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.726240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.726661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.752163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:05.752795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:05.759910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.760394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.760825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.761517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:05.761970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:05.762389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:05.858455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:05.860737 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:05.868451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:05.873146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:05.873146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a95755a1-dc97-44b6-8b92-752b5541e38b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157354 Oct 19 22:26:05.873146 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1843/3691] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:05 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:05.896499 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:05.904726 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-246ccf51-9264-4233-b4dd-068c5c71b7eb tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.156393 Oct 19 22:26:05.905582 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1849/3692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:05 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:06.187046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:06.187636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:06.194000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.194479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.194909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:06.195608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.196055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.196474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:06.256898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:06.264825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8fd9d64a-465f-41ff-8f9b-9d86e4a4d86f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081972 Oct 19 22:26:06.265384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1844/3693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:06 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:06.307729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:06.308339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:06.314408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.314896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.315368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:06.316059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.316515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.316940 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:06.442805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:06.451711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-09f63ab3-f24c-4b8c-80ab-5e07a335ff28 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147872 Oct 19 22:26:06.452281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1850/3694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:06 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:06.896336 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:06.896936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:06.903369 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.903844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.904273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:06.904945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.905390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.905804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:06.928411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:06.929017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:06.935414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.935902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.936340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:06.937030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:06.937482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:06.937902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:07.033035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:07.042258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:07.043648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:07.044806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5f1b65c2-7d9d-4527-90c3-53364b5d7238 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152353 Oct 19 22:26:07.045363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1845/3695] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:06 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:07.068753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:07.077166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a45941d5-fc03-4c96-8fb5-f409f64c344b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152592 Oct 19 22:26:07.077724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1851/3696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:06 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:07.287022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:07.287630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:07.294002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:07.294420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:07.294848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:07.295543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:07.296008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:07.296409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:07.358610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:07.366673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-caca8b67-bbfe-43b3-a02c-05779ac3569d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083456 Oct 19 22:26:07.367259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1846/3697] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:07 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:07.475270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:07.475882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:07.481763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:07.482246 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:07.482683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:07.483392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:07.483846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:07.484269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:07.609090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:07.617121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e6ad9365-9e4e-422d-9afe-d3e63979b409 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145743 Oct 19 22:26:07.618251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1852/3698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:07 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:08.069867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:08.070480 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:08.076776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.077259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.077727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.078409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.078865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.079321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.100618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:08.103359 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:08.106191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:26:08.106373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:26:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 (ip 10.222.0.20) !!! Oct 19 22:26:08.119697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.120248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.120690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.121395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.121846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.122270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.214987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:08.223852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:08.231748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:08.231748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2762c5e5-e67c-44d6-8298-b2f6a416ed0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.160856 Oct 19 22:26:08.231748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1847/3699] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:08 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:08.257930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:08.266222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e6447f37-70b8-47da-92ca-ba48341bac9a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.169567 Oct 19 22:26:08.266804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1853/3700] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:08 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:08.388908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:08.389434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:08.395887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.396364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.396795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.397467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.397918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.398339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.460412 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:08.467573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bcb87c5e-494f-4c5a-8b89-69deef94c924 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082531 Oct 19 22:26:08.468129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1848/3701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:08 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:08.640424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:08.640958 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:08.646851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.647361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.647790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.648464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:08.649470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:08.649891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:08.775404 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:08.783514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-094a2b31-1e08-4d2b-bfc9-0e1ae103e9fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147088 Oct 19 22:26:08.784086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1854/3702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:08 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:09.253656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:09.254253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:09.260845 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.261322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.261749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.262425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.262869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.263328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.289680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:09.290272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:09.296634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.297115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.297576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.298257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.298705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.299164 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.391470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:09.400801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:09.402395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:09.403612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3e9e7a0b-68c6-42f4-8787-ba8da3e45105 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153879 Oct 19 22:26:09.404190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1849/3703] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:09 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:09.433103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:09.441064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-26a5dcdf-cc3b-4a70-8e85-c6f54baa33f3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155252 Oct 19 22:26:09.441622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1855/3704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:09 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:09.490473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:09.491112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:09.497509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.497986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.498417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.499125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.499573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.499993 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.559652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:09.567640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e491a265-490f-4f18-915e-901def201a4d tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.080900 Oct 19 22:26:09.568194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1850/3705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:09 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:09.806040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:09.806645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:09.812583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.813005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.813445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.814119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:09.814567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:09.815006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:09.945604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:09.954078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7e0f1816-aaad-4f06-a6a4-850645cebff4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151873 Oct 19 22:26:09.954652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1856/3706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:09 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:10.429306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:10.429889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:10.432130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:26:10.432378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:26:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 (ip 10.222.0.20) !!! Oct 19 22:26:10.440018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.440503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.440944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:10.441643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.442101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.442527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:10.464853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:10.465470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:10.471799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.472283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.472719 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:10.473409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.473861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.474288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:10.570524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:10.580015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:10.581462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:10.582644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-58ea90e1-0456-4811-ba49-87602239d78c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157383 Oct 19 22:26:10.583250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1851/3707] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:10 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:10.602190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:10.605453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:10.606106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:10.610587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-02a743d4-99e4-416a-a58f-c89c983804ca tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150271 Oct 19 22:26:10.611288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1857/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:10 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:10.611972 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.612451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.612883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:10.613575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.614023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.614444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:10.674125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:10.682556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cfb05418-d400-498b-9f8c-c382c637ce6e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086206 Oct 19 22:26:10.683081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1852/3709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:10 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:10.978145 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:10.978758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:10.984817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.985301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.985741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:10.986430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:10.986886 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:10.987337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:11.115578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:11.124237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9e2e51d1-a2e2-4646-a841-560882fc7c65 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150487 Oct 19 22:26:11.124810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1858/3710] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:10 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:11.612035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:11.612639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:11.619057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:11.619533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:11.619959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:11.620639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:11.621070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:11.621484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:11.633536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:11.634147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:11.640494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:11.640973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:11.641407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:11.642092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:11.642543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:11.642987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:11.752330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:11.761478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:11.763046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:11.764208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8f741a26-d1d5-427d-bee4-c4b4abb2adf8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156096 Oct 19 22:26:11.764762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1853/3711] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:11 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:11.769221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:11.769818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:11.771076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:11.776659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:11.777139 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:11.777569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:11.778254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:11.778702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:11.779148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:11.780671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0a0068ad-099a-4587-bc55-5d51a50caf7d tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150964 Oct 19 22:26:11.781484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1859/3712] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:11 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:11.841786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:11.849879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a0657a3c-f080-4fcd-a004-7caadc6e28f4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084199 Oct 19 22:26:11.850435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1854/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:11 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:12.147263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:12.147868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:12.153795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.154271 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.154699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:12.155398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.155851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.156267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:12.160117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:12.283919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:12.292061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1f3b0d3d-ae75-4240-9ae4-780cd26a8838 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148701 Oct 19 22:26:12.292646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1860/3714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:12 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:12.790939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:12.791565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:12.797985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.798467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.798907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:12.799620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.800073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.800498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:12.803690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:12.804296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:12.810607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.811124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.811560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:12.812245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.812688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.813104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:12.931886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:12.939376 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:12.940581 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:12.942010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:12.943194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d61dedd4-0873-4dc2-a2eb-92a39fc86ec7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156784 Oct 19 22:26:12.943750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1855/3715] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:12 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:12.947697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac57526e-72ba-4b66-9bf3-8d6827bb11a5 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.147729 Oct 19 22:26:12.948027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:12.957572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1861/3716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:12 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:12.957762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:12.957762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.957762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.957762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:12.958123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:12.958123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:12.958123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:13.016314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:13.024712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5b398d54-63b4-4f44-8ae0-69795239b9d1 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.079454 Oct 19 22:26:13.025246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1856/3717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:12 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:13.315916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:13.316532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:13.322918 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:13.323435 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:13.323876 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:13.324817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:13.325270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:13.325697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:13.450418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:13.458469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-19f9a39f-9816-4850-bbdd-d9e2216ea039 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146465 Oct 19 22:26:13.459068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1862/3718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:13 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:13.968093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:13.968708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:13.971307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:13.971920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:13.975163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:13.975645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:13.976075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:13.976756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:13.977713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:13.978127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:13.978677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:13.979382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:13.979821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:13.980512 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:13.980966 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:13.981389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:14.106184 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:14.113389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:14.115450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:14.117171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:14.118988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c5017e01-f276-4b30-8238-bca56a398afd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154826 Oct 19 22:26:14.119564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1857/3719] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:13 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:14.127203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a0673df0-d167-42e8-bf03-e60a8c2a5ac8 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155373 Oct 19 22:26:14.127203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1863/3720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:13 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:14.127414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:14.127414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:14.130738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:14.131254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:14.131727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:14.132420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:14.132880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:14.133343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:14.193411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:14.201864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa42a247-3f0b-42ad-893e-beafdfa45162 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081291 Oct 19 22:26:14.202483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1858/3721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:14 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:14.482455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:14.483115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:14.488975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:14.489450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:14.489879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:14.490557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:14.491037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:14.491459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:14.616046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:14.624154 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c793495a-6c4f-479b-80b5-e41b48e06edc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145586 Oct 19 22:26:14.624717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1864/3722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:14 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:15.145552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:15.146116 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:15.148280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:15.148898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:15.152595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.153129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.153559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.154246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.154691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.155340 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.155465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.155833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.156269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.156970 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.157429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.157854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.288825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:15.291087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:15.297627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:15.299122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:15.299753 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2f5d52a1-6d6b-4807-ac11-591c7f11d907 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155224 Oct 19 22:26:15.300275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-95352b4b-45b3-48c9-9ad2-27aeff1ff236 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158720 Oct 19 22:26:15.300398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1865/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:15 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:15.301011 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1859/3724] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:15 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:15.305579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:15.306185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:15.311920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.312411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.312850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.313540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.313999 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.314426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.374800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:15.382910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-33192567-5c3d-4c6d-b476-dfbe3b5e6187 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081567 Oct 19 22:26:15.384075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1866/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:15 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:15.646667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:15.647316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:15.653215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.653697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.654132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.654814 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:15.655296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:15.655722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:15.670648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:15.781530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:15.791706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a5749993-c44d-4fd8-a1d2-a2aadc4ba862 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.148806 Oct 19 22:26:15.792566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1860/3726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:15 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:16.324867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:16.325553 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:16.327181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:16.332062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:16.332798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.333276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.333705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.334048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.334388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.334561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.334837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.335066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.335280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.335750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.336205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.337267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.464308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:16.468947 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:16.472727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bfd4d46a-aef1-45fb-a7f2-23221e8b3d9e tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152790 Oct 19 22:26:16.473298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1867/3727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:16 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:16.477772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:16.477927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:16.478373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:16.479423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:16.480585 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ee377aaa-8a06-4380-8f13-d0cf4d67c56e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157546 Oct 19 22:26:16.481301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1861/3728] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:16 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:16.489065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.489607 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.490046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.490739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.491220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.491644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.554732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:16.563265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4946ee6d-1d70-4d74-bc9f-583fed4ee458 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089004 Oct 19 22:26:16.563826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1868/3729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:16 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:16.815131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:16.815740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:16.822291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.822778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.823230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.823910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:16.824621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:16.825068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:16.948458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:16.956758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-47021280-3797-4e36-ad1e-cd98ceb41fc6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145519 Oct 19 22:26:16.957317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1862/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:16 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:17.496483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:17.497094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:17.503588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.504073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.504511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:17.505191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.505315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:17.505749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.505891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:17.506049 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:17.512194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.512672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.513100 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:17.513774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.514225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.514642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:17.633950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:17.642294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4ecdfd7c-a289-4965-a2f9-1fa8707d4356 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.149608 Oct 19 22:26:17.642865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1869/3731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:17 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:17.647281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:17.647906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:17.649909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:17.654054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.654535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.654984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:17.655668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.656116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.656535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:17.659240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:17.660698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:17.661872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fb41bb76-4887-4b8b-b268-eca1679d9a7d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.160402 Oct 19 22:26:17.662458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1863/3732] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:17 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:17.717675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:17.725587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ace155e5-25b8-4b6a-bf16-329296d11eaa tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081778 Oct 19 22:26:17.726144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1870/3733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:17 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:17.979659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:17.980310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:17.986086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.986560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.987016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:17.987688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:17.988133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:17.988547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:18.114657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:18.123728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-756f880e-4eb8-4c46-bc6e-efa663a9989f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147931 Oct 19 22:26:18.124292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1864/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:17 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:18.665775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:18.666364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:18.672808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:18.673284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:18.673711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:18.674385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:18.674832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:18.675276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:18.687429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:18.688045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:18.694250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:18.694727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:18.695193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:18.696368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:18.696811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:18.697228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:18.808186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:18.816433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-24cd72e2-a19a-40fa-a04a-b71678d47c98 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154523 Oct 19 22:26:18.817010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1871/3735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:18 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:18.822077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:18.822669 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:18.826868 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:18.828731 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:18.829141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:18.829576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:18.830268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:18.830723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:18.831169 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:18.836121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:18.838352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:18.839804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0dd667c6-aa73-4f14-91ad-25cf762c8ab7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.155947 Oct 19 22:26:18.840565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1865/3736] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:18 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:18.893210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:18.901249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7e77931e-b047-40ca-9a01-298bcb3907be tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083305 Oct 19 22:26:18.901824 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1872/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:18 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:19.147684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:19.148301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:19.155077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:19.155564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:19.156075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:19.156768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:19.157223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:19.157686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:19.287009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:19.295115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-19621e2f-cd43-4ded-a2c9-79d4e2be5a0c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151367 Oct 19 22:26:19.295687 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1866/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:19 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:19.840522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:19.841127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:19.847896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:19.848382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:19.848813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:19.849487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:19.849936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:19.850351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:19.864897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:19.865508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:19.872458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:19.872943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:19.873386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:19.874076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:19.874597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:19.875050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:19.983160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:19.991484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b67c068e-39cc-4a30-997f-e8e956fd5f94 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.154829 Oct 19 22:26:19.992055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1873/3739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:19 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:19.997013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:19.997617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:20.003204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:20.003690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:20.004128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:20.004818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:20.005274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:20.005694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:20.012428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:20.020835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:20.022262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:20.023453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-74550e6a-da02-47e7-8cf2-6fe8f4f38691 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162431 Oct 19 22:26:20.024055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1867/3740] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:19 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:20.070147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:20.078674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fd73b208-2f79-42c4-a1f8-e9673c646482 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085130 Oct 19 22:26:20.079280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1874/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:19 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:20.317704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:20.318245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:20.324414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:20.324895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:20.325350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:20.326010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:20.326464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:20.326884 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:20.455365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:20.463996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-913e7a36-7626-4a77-b3ee-c4846fc1dcd6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150293 Oct 19 22:26:20.464574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1868/3742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:20 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:21.015752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:21.016390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:21.022853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.023371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.023808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.024491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.025572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.025994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.049753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:21.050274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:21.057455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.057949 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.058394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.059147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.059604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.060033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.155851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:21.164180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-822b0eb5-f53e-48dc-8448-adbf78576bbd tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152237 Oct 19 22:26:21.164963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1875/3743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:21 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:21.172965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:21.173580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:21.179545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.180025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.180464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.181696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.182150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.182576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.191879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:21.201504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:21.202980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:21.204143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a9b1f55c-72ab-41a6-af82-a68041b37c6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.158406 Oct 19 22:26:21.204709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1869/3744] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:21 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:21.244997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:21.247190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:21.253659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dddfa320-589a-4c30-a610-1049706b5844 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085457 Oct 19 22:26:21.254265 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1876/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:21 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:21.487680 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:21.488296 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:21.494859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.495374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.495815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.496502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:21.496988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:21.497417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:21.621558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:21.629695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e7f9b53b-7b3e-4987-9688-6ccb7a85bad2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145872 Oct 19 22:26:21.630256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1870/3746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:21 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:22.187552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:22.188168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:22.194791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.195314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.195755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.196445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.197413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.197839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.229183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:22.229903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:22.236356 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.236843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.237281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.237975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.238431 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.238858 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.376864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:22.386634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:22.388768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:22.389332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c5ee74cd-f99a-4a30-85af-f808272a1d6e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.163999 Oct 19 22:26:22.389902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1871/3747] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:22 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:22.394537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:22.395189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:22.403521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.404035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.404910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.405632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.406083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.406618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.471957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:22.480639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2ea6459d-c132-42d1-ae97-05aa4599d081 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089697 Oct 19 22:26:22.481454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1872/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:22 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:22.542264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:22.550450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f3376f27-955e-4342-aa0d-35ee26bba0b2 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.367132 Oct 19 22:26:22.551047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1877/3749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:22 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:22.652516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:22.653058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:22.659002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.659487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.659932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.660642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:22.661099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:22.661524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:22.792378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:22.800634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b3cfa94-9a9a-4699-87cc-bf3252d71689 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.152500 Oct 19 22:26:22.801191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1873/3750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:22 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:23.415391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:23.416029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:23.422599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.423118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.423559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.424251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.424703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.425130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.503092 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:23.503706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:23.510759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.511272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.511717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.512411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.512875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.513325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.549832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:23.559245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:23.560696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:23.561893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7a527f88-9982-42e4-b96a-4dedd97b0fdf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.150424 Oct 19 22:26:23.562466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1878/3751] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:23 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:23.712978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:23.712978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:23.713623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:23.713888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.713888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.713888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.713888 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.714149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.714149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.714278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-13d3d15b-4a07-46ef-aad9-b5aad123b584 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084804 Oct 19 22:26:23.714278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1874/3752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:23 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:23.720427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:23.730594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-53864439-eeea-4561-b45a-7e0d165b785f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.160879 Oct 19 22:26:23.731347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1879/3753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:23 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:23.824491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:23.825067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:23.831064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.831542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.831973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.832647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:23.833096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:23.833515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:23.964108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:23.972171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aaae82e9-faea-4832-b0d9-499f4f5974fb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.151870 Oct 19 22:26:23.972736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1875/3754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:23 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:24.607596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:24.608224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:24.614586 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:24.615098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:24.615530 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:24.616205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:24.616653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:24.617101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:24.651273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:24.651874 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:24.654197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:24.659068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:24.659530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:24.659970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:24.660650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:24.661107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:24.661514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:24.677978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:24.686184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-89643365-2802-4678-8db3-c98b322f228b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.082941 Oct 19 22:26:24.686735 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1880/3755] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:24 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:24.754413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:24.755061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:24.761342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:24.761816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:24.762245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:24.762927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:24.763399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:24.763821 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:24.796896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:24.805722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:24.807720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:24.808923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-65540be9-a67d-4f6a-9c1b-56a1991300c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.162234 Oct 19 22:26:24.809499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1876/3756] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:24 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:24.888949 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:24.897294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-aee651a5-76f8-4a83-8e4c-6c952825eb6a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146724 Oct 19 22:26:24.897860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1881/3757] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:24 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:24.994891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:24.995528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:25.001441 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.001925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.002381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:25.003091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.003549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.003971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:25.007865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:25.128499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:25.137156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91673d3e-3cc9-4622-9ef8-3597d66a415d tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146090 Oct 19 22:26:25.137721 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1877/3758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:24 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:25.709505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:25.710051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:25.716974 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.717494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.717920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:25.718644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.719139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.719566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:25.785736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:25.794820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2709ce70-3a1a-48fa-8f12-e1e0bf92b639 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.089187 Oct 19 22:26:25.795447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1882/3759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:25 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:25.834677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:25.835198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:25.842371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.842851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.843308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:25.843989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.844498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.844853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:25.920110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:25.920720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:25.926749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.927372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.927868 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:25.928564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:25.929018 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:25.929446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:26.064208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:26.067031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:26.072930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-46708008-28e3-47a8-9085-baea38303860 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.156640 Oct 19 22:26:26.073859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1883/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:25 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:26.076803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:26.078339 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:26.079635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c3f7f7bd-9c5c-4562-8b0e-be0d6ea4e132 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.248938 Oct 19 22:26:26.080434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1878/3761] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:25 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:26.160484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:26.161090 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:26.167212 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:26.167685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:26.168115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:26.168790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:26.169241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:26.169686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:26.293993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:26.302167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-50baad37-bc74-4bba-9cdd-97edb53133e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.145575 Oct 19 22:26:26.302728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1884/3762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:26 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:26.817455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:26.818067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:26.824050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:26.824800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:26.825233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:26.825913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:26.826366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:26.826788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:26.887159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:26.895228 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e4fe1495-caa5-486e-81d1-869043868690 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081891 Oct 19 22:26:26.895785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1879/3763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:26 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:27.096127 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:27.096673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:27.103223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.103703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.104137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.104815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.104986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:27.105267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.105685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.105765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:27.111557 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.112032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.112461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.113134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.113579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.113996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.236170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:27.240914 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:27.244907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c7be5779-4263-4a8d-a3e6-fa25b0491108 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152677 Oct 19 22:26:27.245468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1885/3764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:27 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:27.250239 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:27.251739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:27.252902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cb3f9ace-483d-4325-93b8-2ce9dfeee78f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.151695 Oct 19 22:26:27.253454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1880/3765] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:27 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:27.326826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:27.327447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:27.333218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.333697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.334124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.334795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.335276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.335695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.463392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:27.471467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bdd023f8-ec80-4428-b872-4b5b4fd73bbc tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149717 Oct 19 22:26:27.472037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1886/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:27 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:27.916803 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:27.917407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:27.923773 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.924249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.924678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.925362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:27.925827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:27.926231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:27.995286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:28.003426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5aec7af7-752b-449d-ac9e-a15b3d12bdde tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.090629 Oct 19 22:26:28.003998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1881/3767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:27 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:28.268532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:28.269207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:28.271580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:28.276310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:28.276789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:28.277227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:28.277475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:28.277908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:28.278085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:28.278355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:28.278771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:28.284106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:28.284588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:28.285021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:28.285703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:28.286152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:28.286574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:28.410675 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:28.414381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:28.419604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-88248875-9f89-4962-875f-417c99c0548c tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.155044 Oct 19 22:26:28.420186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1887/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:28 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:28.423485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:28.424932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:28.426090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b143675-c106-41a8-8f5b-05821d0399c2 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152451 Oct 19 22:26:28.426641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1882/3769] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:28 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:28.494874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:28.495507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:28.501442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:28.501989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:28.502388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:28.503100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:28.503546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:28.503961 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:28.629418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:28.637763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-467b5057-a2d3-490e-aa9d-2601afa1372a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.147412 Oct 19 22:26:28.638321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1888/3770] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:28 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:29.026715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:29.027355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:29.033710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.034195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.034646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.035465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.035953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.036376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.099811 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:29.107854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3c0c6f1f-aab3-42ec-b682-aa1054eb3ab4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.085544 Oct 19 22:26:29.108476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1883/3771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:29 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:29.442341 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:29.442968 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:29.450505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.451009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.451447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.452126 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.452427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:29.452573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.452988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.453070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:29.459015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.459493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.459927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.460607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.461058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.461477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.580473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:29.590869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cae49a47-62f0-4afe-ade3-47d8d17da441 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.152298 Oct 19 22:26:29.591560 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:29.591709 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1889/3772] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:29 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:29.600432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:29.601888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:29.603095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4bb75285-5211-46f9-a953-df5dd3d37e24 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.154805 Oct 19 22:26:29.603642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1884/3773] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:29 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:29.661489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:29.662088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:29.668549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.669030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.669461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.670133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:29.670608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:29.671050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:29.799415 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:29.808110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-feed07e2-e925-4254-b099-6f8e61b9e875 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150481 Oct 19 22:26:29.808662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1890/3774] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:29 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:30.130266 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:30.130870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:30.137381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.137864 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.138295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.139025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.139484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.139907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.205563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:30.214274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a39390e5-c142-4a72-b7f7-88d5ada0aa0b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087948 Oct 19 22:26:30.214834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1885/3775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:30 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:30.613817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:30.614427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:30.621152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.621629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.622060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.622767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.623248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.623664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.628747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:30.629359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:30.635761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.636247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.636683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.637368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.637820 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.638244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.751580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:30.760468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7b31006b-acee-4786-b14d-d83e46256d23 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150488 Oct 19 22:26:30.761051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1891/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:30 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:30.766648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:30.775870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:30.777377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:30.785738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-41cfbbd3-8ca8-4b43-a533-8d389832ea9c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.160753 Oct 19 22:26:30.786418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1886/3777] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:30 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:30.831223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:30.831829 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:30.837793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.838276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.838715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.839425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:30.839879 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:30.840301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:30.970079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:30.976996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5c4ec008-4b13-450c-bc91-a9706eea7748 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149677 Oct 19 22:26:30.977572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1892/3778] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:30 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:31.237482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:31.238096 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:31.245140 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:31.245624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:31.246058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:31.246741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:31.247226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:31.247646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:31.311853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:31.320088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a408b1e3-0e75-47d3-8b58-1c49b4e91eed tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086609 Oct 19 22:26:31.320655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1887/3779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:31 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:31.783680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:31.784298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:31.791555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:31.792092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:31.792472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:31.793160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:31.793613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:31.794034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:31.809023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:31.810823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:31.811481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:31.817264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:31.817747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:31.818173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:31.818851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:31.819331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:31.819751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:31.922409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:31.930567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c8773419-342f-4a50-9f84-7e8f3f76ccb3 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150760 Oct 19 22:26:31.931170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1893/3780] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:31 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:31.947792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:31.956802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:31.958259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:31.959509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e2022546-62b4-4ce0-83e9-656588a10fa6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152529 Oct 19 22:26:31.960066 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1888/3781] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:31 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:31.999977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:32.000609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:32.011300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.011815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.012508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:32.013204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.013663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.014098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:32.141912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:32.150048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fac056e3-08e0-4b4d-bb5e-571e3faaf702 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153905 Oct 19 22:26:32.150609 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1894/3782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:31 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:32.342976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:32.343613 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:32.349865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.350337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.350764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:32.351470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.351917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.352334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:32.414463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:32.423440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-405f437b-85e0-49b7-9676-b7b58ac51d76 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084343 Oct 19 22:26:32.424008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1889/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:32 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:32.955468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:32.956085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:32.963612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.964104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.964547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:32.965242 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.965700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.966143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:32.985582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:32.986312 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:32.993045 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.993623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.994054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:32.994888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:32.995454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:32.995861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:33.104898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:33.114189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f31b0493-6f01-45bf-95e3-9657ef82bcb9 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.162861 Oct 19 22:26:33.114764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1895/3784] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:32 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:33.136349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:33.145043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:33.146541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:33.147797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f937a95f-e8ca-4d83-8fec-b0cbd682ba63 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.166180 Oct 19 22:26:33.148426 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1890/3785] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:32 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:33.173107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:33.173801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:33.179911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:33.180476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:33.181525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:33.182284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:33.182810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:33.183339 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:33.311423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:33.319751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-62db4f4b-8e06-4f8c-b0f9-c6b7466200cb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.150461 Oct 19 22:26:33.320321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1896/3786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:33 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:33.445453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:33.446064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:33.452639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:33.453125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:33.453562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:33.454274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:33.454733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:33.455180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:33.517364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:33.525516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4172b81e-bdde-48b7-870d-9ab2808ed180 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083868 Oct 19 22:26:33.526078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1891/3787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:33 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:34.138578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:34.139229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:34.145602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.146076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.146508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.147216 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.147662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.148079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.172927 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:34.173530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:34.179478 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.180119 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.180387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.181076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.181528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.181951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.285011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:34.293228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c0b2eef6-ead7-48da-8308-3d9805a675af tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.159042 Oct 19 22:26:34.293806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1897/3788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:34 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:34.317929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:34.327282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:34.328709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:34.329860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2b8a9ce4-14e3-4ab5-86cd-5e5b26262655 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.160813 Oct 19 22:26:34.330421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1892/3789] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:34 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:34.344228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:34.344845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:34.350827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.351347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.351789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.352468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.352953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.353389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.479072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:34.487226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c224fa59-5b39-4a05-a638-f7d2bd5b06c3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146832 Oct 19 22:26:34.487799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1898/3790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:34 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:34.548388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:34.549002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:34.555381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.556393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.556835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.557525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:34.557982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:34.558409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:34.622035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:34.624202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:34.630657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-52576552-514a-4d72-88ce-a04a81e366b2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.086080 Oct 19 22:26:34.631274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1893/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:34 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:35.316024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:35.316629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:35.323010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.323489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.323922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.324866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.325311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.325730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.356663 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:35.357274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:35.363465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.363955 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.364394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.365083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.365544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.365970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.457034 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:35.465738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f7fb99c7-b548-453e-96f6-11cdcdcb435b tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.153540 Oct 19 22:26:35.466309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1899/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:35 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:35.494014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:35.502628 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:35.504128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:35.505372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dc819c92-34ff-4bdb-8823-d49df29c09f4 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.153616 Oct 19 22:26:35.505991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1894/3793] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:35 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:35.509558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:35.510166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:35.516016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.516491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.516919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.517592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.518035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.518452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.645694 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:35.655136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f7e71f5d-36c4-49a2-8f8d-12e5c773a385 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.149279 Oct 19 22:26:35.655715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1900/3794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:35 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:35.656677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:35.657295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:35.663742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.664249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.664681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.665364 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:35.665816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:35.666310 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:35.727979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:35.736043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0b1928d0-c8ac-4122-a042-2bef13d2590f tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.083288 Oct 19 22:26:35.736605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1895/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:35 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:36.489182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:36.489822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:36.497051 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.497525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.497955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.498633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.499112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.499531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.529537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:36.530141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:36.536031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.536509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.536942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.537759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.538051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.538468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.627673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:36.635870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-83078255-bf23-4c57-8e26-92ec4f6f422f tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150487 Oct 19 22:26:36.636633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1901/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:36 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:36.670291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:36.677701 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:36.678308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:36.679272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:36.680720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:36.683121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b95bf7c6-46ee-4504-a10d-d9fd4686a2ff tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.157325 Oct 19 22:26:36.685043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.685525 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.685957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.686648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.687128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.687546 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.689907 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1896/3797] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:36 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:36.757605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:36.758129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:36.763984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.764461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.764889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.765562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:36.766008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:36.766425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:36.818288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:36.827303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ca1d9420-d763-41fe-a047-e850817b5299 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.153515 Oct 19 22:26:36.827542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:36.827880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1902/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:36 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:36.835568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-727b9ba8-6ca9-4860-8aa1-181ec8fc0220 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.081867 Oct 19 22:26:36.836268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1897/3799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:36 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:37.659140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:37.659672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:37.666086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.666564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.667016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.667693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.668139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.668556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.708521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:37.709128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:37.715603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.716084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.716520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.717210 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.717665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.718084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.797068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:37.805541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1b8b769d-9d68-42aa-a267-33a1e9ec28da tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.150324 Oct 19 22:26:37.806837 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1903/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:37 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:37.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:37.851326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:37.851927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:37.854544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:37.856022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:37.857198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-867b762e-5bd5-4019-8615-2e9e76bc5c77 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.152614 Oct 19 22:26:37.857761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1898/3801] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:37 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:37.858317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.858843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.859259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.859938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.860533 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.860954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.862193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:37.862799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:37.869113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.869740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.870182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.870872 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:37.871355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:37.871808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:37.938093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:37.946619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cbe403f4-abe0-4f32-9bfe-b8f4669d957a tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.087863 Oct 19 22:26:37.947195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1899/3802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:37 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:37.992791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:38.001484 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9b4b26fb-a52a-4dc6-9945-14dd8088e44a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.154525 Oct 19 22:26:38.002044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1904/3803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:37 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:38.830135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:38.830761 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:38.837769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:38.838244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:38.838693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:38.839380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:38.839832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:38.840251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:38.883399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:38.884560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:38.890896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:38.891401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:38.891833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:38.892511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:38.892979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:38.893393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:38.965111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:38.973268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-528f630d-dd63-41e9-999a-bc342889cb36 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.146966 Oct 19 22:26:38.973833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1900/3804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:38 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:38.978268 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:38.978869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:38.984718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:38.985206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:38.985641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:38.986329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:38.986781 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:38.987231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:39.024055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:39.033426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:39.034871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:39.036059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f8ced5ca-9a49-40f7-99c1-b47864962215 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.156537 Oct 19 22:26:39.036624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1905/3805] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:38 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:39.040973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:39.041523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:39.047255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:39.047738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:39.048179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:39.048869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:39.049323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:39.049590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:39.049770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:39.059044 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf60dcd8-629e-4273-a07b-6d48530b2dac tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 200 len: 1368 microversion: 2.1 time: 0.084241 Oct 19 22:26:39.059837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1901/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:38 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:39.082048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-aa91c562-c057-4289-bd40-30dab08e48c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '.version_select at 0x7f7336553160>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:39.175707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:39.184280 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-963247d4-0940-4e52-b848-39f07a0e5820 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.146725 Oct 19 22:26:39.184841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1906/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:39 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:39.207419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-aa91c562-c057-4289-bd40-30dab08e48c4 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323590936" status: 202 len: 0 microversion: 2.1 time: 0.128919 Oct 19 22:26:39.208167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1902/3808] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 19 22:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323590936 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 22:26:39.996335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:39.997218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] [instance: a9df3c36-da16-4a07-b4a2-c426787bd720] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:40.004816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:40.005301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:40.005743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:40.006433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:40.006938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:40.007383 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:40.062000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:40.063316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:40.070671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:40.071711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:40.072157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:40.072943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:40.073393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:40.073885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:40.189984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86dbc6cb1f144de9b83ccac964a1b3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6529fcc0c4c4487ab023942957692c3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:40.204060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0799ca8d-2f84-476b-b27b-22c9155a736a tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720" status: 200 len: 1601 microversion: 2.1 time: 0.211294 Oct 19 22:26:40.205703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1907/3809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:39 2022] GET /compute/v2.1/servers/a9df3c36-da16-4a07-b4a2-c426787bd720 => generated 1601 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:40.215283 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:40.216333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:40.223445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:40.223936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:40.224381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:40.226518 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:40.229866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:40.230448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:40.259467 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:40.268692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:40.270209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:40.271399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-adf6f183-cf26-4c1d-8d8b-de26befb3b3b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 200 len: 1802 microversion: 2.20 time: 0.213507 Oct 19 22:26:40.271956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1903/3810] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:40 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:40.278224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a658077b-9dee-4d05-97d3-10acaf00c601 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'create', calling method: .version_select at 0x7f733656e9d0>, body: {"keypair": {"name": "tempest-keypair-894525925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVkLoo47sm5IPqWclxEJxdtwSDiKWCG50ppUOIQm9i6W1lKb4+jJg90y354YEk4eFjJYAEqToIgLEkw/nN3wp/SBBOLeNAI23iJu1AnrbzTuzLD1nrKmOy33s6HHROiZg=="}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:40.295645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a658077b-9dee-4d05-97d3-10acaf00c601 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:26:40.299588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-a658077b-9dee-4d05-97d3-10acaf00c601 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for user 5ae13baf5df84b588fa65e8dffec4bbf and project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:26:40.375160 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:40.384487 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a658077b-9dee-4d05-97d3-10acaf00c601 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111164 Oct 19 22:26:40.385076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1904/3811] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:26:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:26:40.385420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7e2b75ee-1269-43a9-a5fb-5dd55cb33faf tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.178519 Oct 19 22:26:40.394576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1908/3812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:40 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:40.396646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f5ef1ce9-f72c-4b0e-8dce-7f9f01a61b24 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] Calling method '.version_select at 0x7f733656a9d0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:40.396738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9cef9696-b8cf-4d60-84fa-1c167085e874 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '.version_select at 0x7f7332c24940>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:40.481948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f5ef1ce9-f72c-4b0e-8dce-7f9f01a61b24 tempest-TestMinimumBasicScenario-707634737 tempest-TestMinimumBasicScenario-707634737-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1898465471" status: 202 len: 0 microversion: 2.1 time: 0.095741 Oct 19 22:26:40.482591 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1905/3813] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Oct 19 22:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1898465471 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:26:40.504372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9cef9696-b8cf-4d60-84fa-1c167085e874 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379585045" status: 204 len: 0 microversion: 2.20 time: 0.117362 Oct 19 22:26:40.505037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1909/3814] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Oct 19 22:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379585045 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 22:26:41.409769 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:41.410380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:41.417559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:41.418042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:41.418473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:41.419188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:41.419640 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:41.424971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:41.596554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:41.605897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fe12ac9a-48aa-41b9-a946-200c2b542f10 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 200 len: 1725 microversion: 2.1 time: 0.200567 Oct 19 22:26:41.606493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1906/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:41 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:41.631151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c7ed17d-f2fa-453d-ad0d-f303c72b6985 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '.version_select at 0x7f7336553f70>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:41.703379 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-7a200739-0b65-4ff3-ba2b-ddb2818fbf0a req-123c3238-31b3-432d-ac4e-8221d88e74d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:41.735149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7a200739-0b65-4ff3-ba2b-ddb2818fbf0a req-123c3238-31b3-432d-ac4e-8221d88e74d8 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:41.735827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7a200739-0b65-4ff3-ba2b-ddb2818fbf0a req-123c3238-31b3-432d-ac4e-8221d88e74d8 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:41.736274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7a200739-0b65-4ff3-ba2b-ddb2818fbf0a req-123c3238-31b3-432d-ac4e-8221d88e74d8 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:41.748121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c7ed17d-f2fa-453d-ad0d-f303c72b6985 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-465514843" status: 202 len: 0 microversion: 2.1 time: 0.121077 Oct 19 22:26:41.748710 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1907/3816] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 19 22:26:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-465514843 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:26:41.769661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-7a200739-0b65-4ff3-ba2b-ddb2818fbf0a req-123c3238-31b3-432d-ac4e-8221d88e74d8 service nova] Creating event network-changed:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:26:41.809825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-7a200739-0b65-4ff3-ba2b-ddb2818fbf0a req-123c3238-31b3-432d-ac4e-8221d88e74d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191756 Oct 19 22:26:41.810459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1910/3817] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:26:41.893057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0cd6aea9-0570-4b49-b82e-3e5087348959 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'create', calling method: .version_select at 0x7f733654e1f0>, body: {"keypair": {"name": "tempest-keypair-344050180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyMEJrjPwFyCphQ62T5SIxdEuwxFcByA0/NssBEOcmconnQiLV7ULKLFcmHRLreVlnBt7D3IpZeEwOLFZju3z+ks7mCtc08YOw4PxTaUwh1j2ptDN0FlTyBTmElDwkzUg=="}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:41.919343 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-0cd6aea9-0570-4b49-b82e-3e5087348959 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for project 88309b84283a4052aa1d957047390cb8. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:26:41.930471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-0cd6aea9-0570-4b49-b82e-3e5087348959 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for user f9b4be7642f3441ab83cf81e1029e017 and project 88309b84283a4052aa1d957047390cb8. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:26:42.041644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0cd6aea9-0570-4b49-b82e-3e5087348959 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.152832 Oct 19 22:26:42.042265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1908/3818] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Oct 19 22:26:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 22:26:42.147102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:42.149078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:42.159410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:42.160229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:42.160747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:42.161526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:42.162083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:42.162572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:42.191470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:26:42.194798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:42.617841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5dd5d7e4-c643-47f3-a00e-d45b55744b64 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 204 len: 0 microversion: 2.1 time: 0.476868 Oct 19 22:26:42.627030 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1911/3819] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:26:42 2022] DELETE /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:26:42.628200 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:42.629533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:42.636477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:42.637186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:42.638222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:42.639355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:42.640227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:42.640861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:43.035901 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:43.045285 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eaad1c20-41b6-4398-b225-ac5a032a1ea9 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1507 microversion: 2.1 time: 0.421865 Oct 19 22:26:43.046457 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1909/3820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:42 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:44.105912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:44.105912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:44.105912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:44.105912 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:44.106655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:44.106655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:44.106655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:44.106655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:44.404798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:44.423061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9b723478-0d3b-4a18-801b-181d03572036 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1465 microversion: 2.1 time: 0.355417 Oct 19 22:26:44.424803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1912/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:44 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1465 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:44.593863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-6511ca43-9621-4ff3-9eac-b16320f3bc53 req-ea404352-c9e6-4f15-b661-452232325fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8aa232-0ce1-4e0a-a383-9543404033fd", "name": "network-vif-deleted", "tag": "2503d797-46d9-4608-9c22-fea52cf1c79f"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:44.608651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6511ca43-9621-4ff3-9eac-b16320f3bc53 req-ea404352-c9e6-4f15-b661-452232325fbe service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:44.613319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6511ca43-9621-4ff3-9eac-b16320f3bc53 req-ea404352-c9e6-4f15-b661-452232325fbe service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:44.613974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6511ca43-9621-4ff3-9eac-b16320f3bc53 req-ea404352-c9e6-4f15-b661-452232325fbe service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:44.686465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-6511ca43-9621-4ff3-9eac-b16320f3bc53 req-ea404352-c9e6-4f15-b661-452232325fbe service nova] Creating event network-vif-deleted:2503d797-46d9-4608-9c22-fea52cf1c79f for instance 4c8aa232-0ce1-4e0a-a383-9543404033fd on hv-cinder-maste Oct 19 22:26:44.723208 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-6511ca43-9621-4ff3-9eac-b16320f3bc53 req-ea404352-c9e6-4f15-b661-452232325fbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252810 Oct 19 22:26:44.730414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1910/3822] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:26:44.775358 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a05d5729-dfb8-4664-ae50-ae949ea25f3e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: .version_select at 0x7f73366d8af0>, body: {"keypair": {"name": "tempest-keypair-850351834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUsgU+ofHoqMhXHQuBCNl/DuiQD9xYhMWnLzFRrcHHxdiHvKIbU/+HtK0u63mlg08UzJ83gsFJDpjhm8af5lqHWiV6iTrSTczTCb30v5Fe6japVFSh7jZEg/KWNzyPzGw=="}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:44.802924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-a05d5729-dfb8-4664-ae50-ae949ea25f3e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:26:44.808913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-a05d5729-dfb8-4664-ae50-ae949ea25f3e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:26:44.838328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-190139830", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34d02d4f-94c3-4c75-9a63-86e5b6f3edc9"}], "security_groups": [{"name": "tempest-securitygroup--1936557852"}], "key_name": "tempest-keypair-894525925", "user_data": "}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:44.945197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a05d5729-dfb8-4664-ae50-ae949ea25f3e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.174034 Oct 19 22:26:44.951734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1913/3823] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:26:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:26:45.013524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] validate_networks() for [('34d02d4f-94c3-4c75-9a63-86e5b6f3edc9', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:26:45.449386 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:45.450831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:45.460048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:45.463268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:45.463947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:45.465737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:45.466795 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:45.467764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:45.539116 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:45.539775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:45.540159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:45.540631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lazy-loading 'fault' on Instance uuid 4c8aa232-0ce1-4e0a-a383-9543404033fd {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:26:45.597665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:45.615600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8bd84efa-b2ad-42d0-ad51-d6a449e69d35 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 200 len: 1312 microversion: 2.1 time: 0.171868 Oct 19 22:26:45.616365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1914/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:45 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:46.114226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-376458396", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15dc36a9-e59a-4cc5-b4c0-b0231775f689"}], "security_groups": [{"name": "tempest-securitygroup--747636656"}], "key_name": "tempest-keypair-344050180", "user_data": "}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:46.143370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:26:46.144407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:26:46.145068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:26:46.145612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:26:46.146248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:26:46.155063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:46.171818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:46.173022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:46.174192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:46.179322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:46.180401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:46.182253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:46.219256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:26:46.224384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Getting quotas for user 5ae13baf5df84b588fa65e8dffec4bbf and project 2caa701e503b44ddb9fbe09d36a53853. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:26:46.242616 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:26:46.246033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:26:46.301802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] validate_networks() for [('15dc36a9-e59a-4cc5-b4c0-b0231775f689', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:26:46.384143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-90ff0af6-9bbe-494d-a44c-3c7edb783ece tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.550689 Oct 19 22:26:46.384887 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1911/3825] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:26:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 22:26:46.403587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-27414cf2-44d8-4340-ae96-0717de7a6b13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:46.412347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-27414cf2-44d8-4340-ae96-0717de7a6b13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:46.551889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-27414cf2-44d8-4340-ae96-0717de7a6b13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:46.560741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-27414cf2-44d8-4340-ae96-0717de7a6b13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1236 microversion: 2.1 time: 0.161052 Oct 19 22:26:46.585422 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1912/3826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:46 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1236 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:46.637846 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:46.638481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 4c8aa232-0ce1-4e0a-a383-9543404033fd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:46.648520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:46.649051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:46.650040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:46.650750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:46.655648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:46.656303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:46.702462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] HTTP exception thrown: Instance 4c8aa232-0ce1-4e0a-a383-9543404033fd could not be found. Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Request method failure captured: Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd HTTP/1.1 Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPnMonHOKSWNkwdVcXpHfQSFB0FjPD1po2qnoc2XPqTZ2ZlTWUk8iqedAofhJc06AFi5K5cbD_e9PoiR3SITTxboMA-_1XhTQFMTl5d7Q50xMRhDzqo01Dj_dsQdk40cHPBvQXYmXfrBMYDLNWTyzyTnNSMnIGF7-UbvkDZhMpX4jU Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:26:46.704167 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65cb45d314f743799145a0fc614ce83e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}] Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 2c7d8acfab1041fc8edf36fd42b06993 Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 4c8aa232-0ce1-4e0a-a383-9543404033fd could not be found. Oct 19 22:26:46.705233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '4c8aa232-0ce1-4e0a-a383-9543404033fd'} Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8aa232-0ce1-4e0a-a383-9543404033fd could not be found. Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:26:46.705843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8aa232-0ce1-4e0a-a383-9543404033fd could not be found. Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8aa232-0ce1-4e0a-a383-9543404033fd could not be found. Oct 19 22:26:46.706749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:26:46.715599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Returning 404 to user: Instance 4c8aa232-0ce1-4e0a-a383-9543404033fd could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:26:46.715599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2abb45b9-dab5-440b-8de9-50e3cfc91bf0 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd" status: 404 len: 111 microversion: 2.1 time: 0.071824 Oct 19 22:26:46.716260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1913/3827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:46 2022] GET /compute/v2.1/servers/4c8aa232-0ce1-4e0a-a383-9543404033fd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 22:26:46.725253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:46.725837 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:46.736514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:46.737166 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:46.744002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:46.744765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:46.745237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:46.745787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:46.779684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Going to try to terminate instance {{(pid=121022) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:26:47.132496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6dcdf956-a35b-49d0-a596-3fc94a450d09 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 204 len: 0 microversion: 2.1 time: 0.414563 Oct 19 22:26:47.133271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1914/3828] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:26:46 2022] DELETE /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:26:47.143409 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-969785b4-58ed-48cf-8202-31b32443d3c9 req-b6173045-fcc1-4d29-95fa-dcb82eb967bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4d839a-a9cb-470c-b01b-b634c0057dd2", "tag": "c43f1a07-3986-4753-ac98-ab6d29e96671"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:47.156609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-969785b4-58ed-48cf-8202-31b32443d3c9 req-b6173045-fcc1-4d29-95fa-dcb82eb967bc service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:47.157085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-969785b4-58ed-48cf-8202-31b32443d3c9 req-b6173045-fcc1-4d29-95fa-dcb82eb967bc service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:47.157517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-969785b4-58ed-48cf-8202-31b32443d3c9 req-b6173045-fcc1-4d29-95fa-dcb82eb967bc service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:47.177169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-969785b4-58ed-48cf-8202-31b32443d3c9 req-b6173045-fcc1-4d29-95fa-dcb82eb967bc service nova] Creating event network-changed:c43f1a07-3986-4753-ac98-ab6d29e96671 for instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 on hv-cinder-maste Oct 19 22:26:47.183154 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-969785b4-58ed-48cf-8202-31b32443d3c9 req-b6173045-fcc1-4d29-95fa-dcb82eb967bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043922 Oct 19 22:26:47.184052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1915/3829] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:26:47.190980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:47.192121 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:47.201105 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:47.201910 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:47.202674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:47.206224 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:47.206835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:47.207559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:47.289801 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:26:47.290324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:26:47.291457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:26:47.291866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:26:47.292272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:26:47.320240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:47.320768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:47.321175 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:47.322561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:47.323064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:47.323693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:47.354440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for project 88309b84283a4052aa1d957047390cb8. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:26:47.362103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Getting quotas for user f9b4be7642f3441ab83cf81e1029e017 and project 88309b84283a4052aa1d957047390cb8. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:26:47.379375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:26:47.381679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:26:47.540740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e7b12bed-9851-490d-a48b-1abbda2e8157 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.431065 Oct 19 22:26:47.541660 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1915/3830] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Oct 19 22:26:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 19 22:26:47.554784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-442bdb18-f5d8-48d7-9cc9-d55b15d59520 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:47.556372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-442bdb18-f5d8-48d7-9cc9-d55b15d59520 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:47.563576 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:47.587768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e1661baf-a852-4aaf-a0be-1698f01963a2 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1521 microversion: 2.1 time: 0.390715 Oct 19 22:26:47.587768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1916/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:47 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:47.600395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:47.602630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:47.610873 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:47.612475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:47.613358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:47.615093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:47.615697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:47.616265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:47.627360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-442bdb18-f5d8-48d7-9cc9-d55b15d59520 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:47.639128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-442bdb18-f5d8-48d7-9cc9-d55b15d59520 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:47.640838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-442bdb18-f5d8-48d7-9cc9-d55b15d59520 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:47.644398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-442bdb18-f5d8-48d7-9cc9-d55b15d59520 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1280 microversion: 2.20 time: 0.092709 Oct 19 22:26:47.644398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1916/3832] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:47 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:26:47.658283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:47.771112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:47.779355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6b4c3637-1e99-40bb-938d-393661ec0b61 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1240 microversion: 2.1 time: 0.189211 Oct 19 22:26:47.780192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1917/3833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:47 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1240 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:48.602871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:48.603501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:48.610012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:48.610489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:48.610923 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:48.611634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:48.612078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:48.613101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:48.672604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:48.673374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:48.681156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:48.684444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:48.684444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:48.684444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:48.684444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:48.684760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:48.719893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:48.729744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bb431f7d-31fd-4406-8ad3-5ac4a1ac2d9e tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1479 microversion: 2.1 time: 0.130658 Oct 19 22:26:48.734163 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1917/3834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:48 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1479 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:48.801841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:48.802461 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:48.811759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:48.811759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:48.811759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:48.812019 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:48.812898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:48.813665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:48.814250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:48.815819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:48.833071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:48.834545 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:48.836077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3a34888c-6b6f-42c5-8618-e53e178f1e1a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1284 microversion: 2.20 time: 0.171526 Oct 19 22:26:48.839889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1918/3835] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:48 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:48.903382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:48.911657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c635d345-ce1a-49dd-8f0f-be9ea9c97735 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1288 microversion: 2.1 time: 0.113732 Oct 19 22:26:48.912234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1918/3836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:48 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:49.207484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-11c691ef-bdd7-4731-8b26-497c9dff3421 req-55522f70-1d58-4137-b829-27cd4fbf3aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91bd34e5-1035-4544-b76f-e925310a40cd", "name": "network-vif-deleted", "tag": "06bb6cf8-0a6d-49a6-81f8-17c7292a8d5d"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:49.222597 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-11c691ef-bdd7-4731-8b26-497c9dff3421 req-55522f70-1d58-4137-b829-27cd4fbf3aba service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:49.223668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-11c691ef-bdd7-4731-8b26-497c9dff3421 req-55522f70-1d58-4137-b829-27cd4fbf3aba service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:49.224477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-11c691ef-bdd7-4731-8b26-497c9dff3421 req-55522f70-1d58-4137-b829-27cd4fbf3aba service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:49.242231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-11c691ef-bdd7-4731-8b26-497c9dff3421 req-55522f70-1d58-4137-b829-27cd4fbf3aba service nova] Creating event network-vif-deleted:06bb6cf8-0a6d-49a6-81f8-17c7292a8d5d for instance 91bd34e5-1035-4544-b76f-e925310a40cd on hv-cinder-maste Oct 19 22:26:49.252349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-11c691ef-bdd7-4731-8b26-497c9dff3421 req-55522f70-1d58-4137-b829-27cd4fbf3aba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047882 Oct 19 22:26:49.256150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1919/3837] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:26:49.347347 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1794157678", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a761516-5fa0-488a-a25d-116b70e5b05e"}], "security_groups": [{"name": "tempest-securitygroup--808778841"}], "key_name": "tempest-keypair-850351834", "user_data": "}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:49.462794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] validate_networks() for [('4a761516-5fa0-488a-a25d-116b70e5b05e', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:26:49.756688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:49.757772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:49.765300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:49.765888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:49.766402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:49.767379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:49.767870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:49.768377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:49.803163 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:49.803731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:49.804172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:49.804617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lazy-loading 'fault' on Instance uuid 91bd34e5-1035-4544-b76f-e925310a40cd {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:26:49.850307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c7d8acfab1041fc8edf36fd42b06993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65cb45d314f743799145a0fc614ce83e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:49.859283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8b84ca1c-62a2-43b2-8d66-77d60d051874 tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 200 len: 1311 microversion: 2.1 time: 0.108030 Oct 19 22:26:49.859861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1920/3838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:49 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:49.864705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:49.865678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:49.872071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:49.872724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:49.873346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:49.874261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:49.875293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:49.875921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:49.991329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:50.015942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:50.017694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:50.019413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f9eca0f8-8d36-4676-acbe-aaa119775809 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1276 microversion: 2.20 time: 0.158638 Oct 19 22:26:50.020188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1921/3839] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:49 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:50.041519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:50.042281 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:50.053453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:50.054215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:50.054673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:50.055481 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:50.056055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:50.056740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:50.146523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:26:50.147006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:26:50.147447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:26:50.147862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:26:50.148453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:26:50.161493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:50.162344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:50.163053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:50.164099 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:50.164705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:50.166256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:50.184852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:26:50.188781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:26:50.214858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:26:50.223751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:26:50.265230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:50.284472 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4bfd56db-81cd-43c6-9748-cdb36a2e787b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1294 microversion: 2.1 time: 0.262960 Oct 19 22:26:50.296308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1922/3840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:50 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:50.349479 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f0c71f3f-1033-492c-b02a-ed80b73a7fdb tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.006842 Oct 19 22:26:50.358867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1919/3841] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:26:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:26:50.367198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-32973be0-865f-4a9c-86c6-82f78d49b131 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:50.367929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-32973be0-865f-4a9c-86c6-82f78d49b131 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:50.502082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-32973be0-865f-4a9c-86c6-82f78d49b131 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:50.516117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-32973be0-865f-4a9c-86c6-82f78d49b131 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1241 microversion: 2.1 time: 0.157177 Oct 19 22:26:50.516117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1923/3842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:50 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:50.884598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:50.885896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] [instance: 91bd34e5-1035-4544-b76f-e925310a40cd] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:50.897046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:50.899676 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:50.900351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:50.903926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:50.904495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:50.905150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:50.934791 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] HTTP exception thrown: Instance 91bd34e5-1035-4544-b76f-e925310a40cd could not be found. Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Request method failure captured: Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd HTTP/1.1 Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPnMonHOKSWNkwdVcXpHfQSFB0FjPD1po2qnoc2XPqTZ2ZlTWUk8iqedAofhJc06AFi5K5cbD_e9PoiR3SITTxboMA-_1XhTQFMTl5d7Q50xMRhDzqo01Dj_dsQdk40cHPBvQXYmXfrBMYDLNWTyzyTnNSMnIGF7-UbvkDZhMpX4jU Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:26:50.936511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65cb45d314f743799145a0fc614ce83e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65cb45d314f743799145a0fc614ce83e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65cb45d314f743799145a0fc614ce83e"}]}] Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 65cb45d314f743799145a0fc614ce83e Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1787989598 Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 2c7d8acfab1041fc8edf36fd42b06993 Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1787989598-project Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 91bd34e5-1035-4544-b76f-e925310a40cd could not be found. Oct 19 22:26:50.937653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '91bd34e5-1035-4544-b76f-e925310a40cd'} Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91bd34e5-1035-4544-b76f-e925310a40cd could not be found. Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:26:50.938227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91bd34e5-1035-4544-b76f-e925310a40cd could not be found. Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91bd34e5-1035-4544-b76f-e925310a40cd could not be found. Oct 19 22:26:50.939191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:26:50.940159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] Returning 404 to user: Instance 91bd34e5-1035-4544-b76f-e925310a40cd could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:26:50.940159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b21a9e8e-a8b5-4840-9109-7fc491474c0d tempest-ServerRescueNegativeTestJSON-1787989598 tempest-ServerRescueNegativeTestJSON-1787989598-project] 10.222.0.20 "GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd" status: 404 len: 111 microversion: 2.1 time: 0.059047 Oct 19 22:26:50.949334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1920/3843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:50 2022] GET /compute/v2.1/servers/91bd34e5-1035-4544-b76f-e925310a40cd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:26:51.046580 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:51.047216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:51.055827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:51.056554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:51.060504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:51.060504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:51.060504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:51.060504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:51.317284 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:51.318467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:51.327373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:51.328162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:51.329013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:51.330039 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:51.330646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:51.331397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:51.450393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:51.463603 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:51.465395 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:51.467145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a1b36492-e2d5-4b75-99c6-6b2300fcf3fd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1332 microversion: 2.20 time: 0.424280 Oct 19 22:26:51.469240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1924/3844] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:51 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1332 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:51.546368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:51.547286 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:51.558162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:51.559230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:51.559675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:51.560425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:51.560886 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:51.561314 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:51.588781 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:51.598945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d26bdd89-49c7-4475-9f37-bd0c5bb5690e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.292265 Oct 19 22:26:51.607046 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1921/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:51 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:51.743786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:51.751712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4bb3d7cd-2f61-49ce-be16-f417c111fb81 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1245 microversion: 2.1 time: 0.214752 Oct 19 22:26:51.752287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1925/3846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:51 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1245 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:52.492093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:52.492832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:52.501055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:52.506232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:52.508430 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:52.510103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:52.511655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:52.512241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:52.624256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:52.625466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:52.630275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:52.633634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:52.639644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:52.640390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:52.641553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:52.642205 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:52.642848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:52.642969 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:52.644716 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:52.645959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-34051cda-b301-48b4-b907-5a6dbd6cf394 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1338 microversion: 2.20 time: 0.157761 Oct 19 22:26:52.646822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1922/3847] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:52 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1338 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:52.776026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:52.776954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:52.792501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:52.793274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:52.794074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:52.795008 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:52.795637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:52.801427 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:52.944629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:52.963845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-2f89f9f9-d016-4452-890a-e2e1ce30c126 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1293 microversion: 2.1 time: 0.192475 Oct 19 22:26:52.964957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1923/3848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:52 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:26:53.163489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:53.171796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cb4cefb7-7357-4379-a346-5cf11b499595 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.552194 Oct 19 22:26:53.187496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1926/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:52 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:53.247107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-03bd6aeb-ddbf-46da-8f49-7beff0bef62f req-7ed2ddff-a922-43fe-b731-82c2730aa575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6abf6bf-942d-486d-9129-7f3a756b5252", "tag": "f6c0dd38-00a0-4528-88f3-dfb525bbed68"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:53.260623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-03bd6aeb-ddbf-46da-8f49-7beff0bef62f req-7ed2ddff-a922-43fe-b731-82c2730aa575 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:53.261392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-03bd6aeb-ddbf-46da-8f49-7beff0bef62f req-7ed2ddff-a922-43fe-b731-82c2730aa575 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:53.262048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-03bd6aeb-ddbf-46da-8f49-7beff0bef62f req-7ed2ddff-a922-43fe-b731-82c2730aa575 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:53.279902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-03bd6aeb-ddbf-46da-8f49-7beff0bef62f req-7ed2ddff-a922-43fe-b731-82c2730aa575 service nova] Creating event network-changed:f6c0dd38-00a0-4528-88f3-dfb525bbed68 for instance c6abf6bf-942d-486d-9129-7f3a756b5252 on hv-cinder-maste Oct 19 22:26:53.289421 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-03bd6aeb-ddbf-46da-8f49-7beff0bef62f req-7ed2ddff-a922-43fe-b731-82c2730aa575 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048096 Oct 19 22:26:53.291428 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1924/3850] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:26:53.674301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:53.675067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:53.690783 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:53.694423 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:53.698804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:53.698804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:53.698804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:53.698804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:53.848304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:53.862596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:53.867251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:53.868784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3133bc6b-166f-4520-b0b9-c536cd472444 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1338 microversion: 2.20 time: 0.198091 Oct 19 22:26:53.872029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1927/3851] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:53 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:53.992768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:53.994670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:54.001052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:54.001558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:54.002000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:54.002707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:54.003249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:54.003682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:54.113095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:54.160922 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-265e23be-4d2f-4df4-99c6-10dbbbbca038 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1299 microversion: 2.1 time: 0.157011 Oct 19 22:26:54.161997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1925/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:53 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:54.194526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:54.195127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:54.213477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:54.216675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:54.216675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:54.216675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:54.216675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:54.216936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:54.840440 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:54.856411 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8867ef76-822a-47e4-8542-360892124847 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.665652 Oct 19 22:26:54.857469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1928/3853] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:54 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:54.894252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:54.895279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:54.905184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:54.907268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:54.909230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:54.910192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:54.910804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:54.911424 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:55.145017 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:55.167142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:55.169447 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:55.170814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4eff739c-e6ba-4396-a720-9895d653d043 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.280809 Oct 19 22:26:55.171686 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1926/3854] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:54 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:55.196230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:55.197094 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:55.209534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:55.210382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:55.211007 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:55.211895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:55.212490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:55.213057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:55.838145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:55.849324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cfa5be37-47ae-4d76-8ebf-3094e342cb7b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.657519 Oct 19 22:26:55.864795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1929/3855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:55 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:55.881311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:55.882011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:55.893704 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:55.894207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:55.894645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:55.897529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:55.898249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:55.902087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:56.198490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:56.199482 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:56.207652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:56.213131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:56.213674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:56.214073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:56.214771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:56.215223 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:56.215651 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:56.472628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:56.485226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-44f86786-7eb2-4847-be20-2157efaf52e0 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.607619 Oct 19 22:26:56.485830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1927/3856] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:55 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:56.660694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:56.673490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:56.675082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:56.678155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5a005b68-5973-4811-9782-cce18d3972a8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.484268 Oct 19 22:26:56.682935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1930/3857] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:56 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:56.880549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:56.881757 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:56.893872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:56.895190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:56.897522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:56.897522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:56.897815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:56.898264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:56.978075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-70d41d7c-862e-4643-9cc3-7dff3c190b9d req-6969633b-1690-4b6e-99fc-0490ec2cedbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72787a88-c3f6-432e-9ba6-ebfa6ebadb6e", "tag": "228b0721-dbfa-421b-a270-1d3ba83a2f77"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:56.998448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-70d41d7c-862e-4643-9cc3-7dff3c190b9d req-6969633b-1690-4b6e-99fc-0490ec2cedbc service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:56.998944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-70d41d7c-862e-4643-9cc3-7dff3c190b9d req-6969633b-1690-4b6e-99fc-0490ec2cedbc service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:56.999390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-70d41d7c-862e-4643-9cc3-7dff3c190b9d req-6969633b-1690-4b6e-99fc-0490ec2cedbc service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:57.025592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-70d41d7c-862e-4643-9cc3-7dff3c190b9d req-6969633b-1690-4b6e-99fc-0490ec2cedbc service nova] Creating event network-changed:228b0721-dbfa-421b-a270-1d3ba83a2f77 for instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e on hv-cinder-maste Oct 19 22:26:57.032425 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-70d41d7c-862e-4643-9cc3-7dff3c190b9d req-6969633b-1690-4b6e-99fc-0490ec2cedbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058774 Oct 19 22:26:57.033715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1931/3858] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:26:57.245977 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:57.255571 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-19282ce2-8d27-448f-8003-ee683fb45aca tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.381668 Oct 19 22:26:57.268815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1928/3859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:56 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:57.431630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-3c26d4b8-4cd2-4a98-aad8-d7d08a036d5c req-7cfd7395-5fb6-4b4c-85ec-728b50f5019f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1afd0c9-fe0b-4d41-a64e-d8f1e4206920", "tag": "579c4679-6968-45b0-9575-4b5c79108416"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:26:57.459355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3c26d4b8-4cd2-4a98-aad8-d7d08a036d5c req-7cfd7395-5fb6-4b4c-85ec-728b50f5019f service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:57.461083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3c26d4b8-4cd2-4a98-aad8-d7d08a036d5c req-7cfd7395-5fb6-4b4c-85ec-728b50f5019f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:57.461785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3c26d4b8-4cd2-4a98-aad8-d7d08a036d5c req-7cfd7395-5fb6-4b4c-85ec-728b50f5019f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:57.479327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-3c26d4b8-4cd2-4a98-aad8-d7d08a036d5c req-7cfd7395-5fb6-4b4c-85ec-728b50f5019f service nova] Creating event network-changed:579c4679-6968-45b0-9575-4b5c79108416 for instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 on hv-cinder-maste Oct 19 22:26:57.485442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-3c26d4b8-4cd2-4a98-aad8-d7d08a036d5c req-7cfd7395-5fb6-4b4c-85ec-728b50f5019f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063254 Oct 19 22:26:57.486828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1932/3860] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:26:57.511182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:57.512815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:57.522064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:57.522830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:57.523549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:57.524497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:57.525429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:57.526005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:57.710755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:57.717909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:57.729706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:57.730716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:57.732315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:57.733986 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:57.734674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:57.735516 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:58.175180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:58.204681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-11edc594-37f4-4714-878f-3bb21985b089 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.698761 Oct 19 22:26:58.207231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1929/3861] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:57 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:58.282412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:58.283729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:58.295020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:58.296351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:58.297790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:58.300723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:58.302928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:58.304335 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:58.317637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:58.330284 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:58.331881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:58.333270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1224c98c-9609-4204-952e-90f7942b7e76 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.629368 Oct 19 22:26:58.334050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1933/3862] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:57 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:58.909774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:58.918875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0379d309-f742-46a2-ade6-bdf90e7a19f7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.640950 Oct 19 22:26:58.921535 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1930/3863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:58 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:59.233483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:59.234933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:59.244029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:59.244525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:59.245051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:59.245712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:59.246213 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:59.246641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:59.373542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:59.374155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:59.398398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:59.398398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:59.398398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:59.405942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:59.406627 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:59.411846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:59.432055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:26:59.515592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:59.527373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e1069664-b759-44ff-aa43-8f90ae11551b tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.300741 Oct 19 22:26:59.528353 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1934/3864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:59 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:26:59.746282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:59.755065 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:59.756507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:26:59.757820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b7b789b5-ba72-4a4f-a79a-b54aec7524ad tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.389551 Oct 19 22:26:59.758388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1931/3865] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:26:59 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:26:59.951074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:26:59.951074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:26:59.957355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:59.958169 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:59.958697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:26:59.959549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:26:59.960106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:26:59.960906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:00.110221 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:00.119589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e2496094-8006-4bf6-b567-52000e600e7f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.174264 Oct 19 22:27:00.120571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1935/3866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:26:59 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:00.556863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:00.556863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:00.561989 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=4 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:00.562750 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=18 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:00.564852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:00.565345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:00.565784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:00.566490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:00.566945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:00.567425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:00.783904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:00.785089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:00.791300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:00.794503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=18 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:00.803243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:00.803243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:00.803243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:00.803243 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:00.803652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:00.803652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:00.813687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-347ca85b-76ee-4840-9aa9-71ea4019adbd tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.265318 Oct 19 22:27:00.824685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1932/3867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:00 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:01.025010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:01.033174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:01.038089 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:01.041726 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:01.043671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf4f611a-8157-4de0-8888-d07a37919399 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.263708 Oct 19 22:27:01.044804 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1936/3868] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:00 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:27:01.146309 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:01.147556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:01.155334 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:01.155880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:01.156255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:01.157410 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:01.157871 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:01.158288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:01.398333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:01.407401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bb68da52-f25c-4a58-b737-2208c6cddb6f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.267489 Oct 19 22:27:01.420237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1933/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:01 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:01.472125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-9dd9720e-fe5d-4f4e-95a0-25e3077da47d req-2502966d-aa54-48d3-9526-e22b17200713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6abf6bf-942d-486d-9129-7f3a756b5252", "name": "network-vif-plugged", "status": "completed", "tag": "f6c0dd38-00a0-4528-88f3-dfb525bbed68"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:27:01.494170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-9dd9720e-fe5d-4f4e-95a0-25e3077da47d req-2502966d-aa54-48d3-9526-e22b17200713 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:01.501203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-9dd9720e-fe5d-4f4e-95a0-25e3077da47d req-2502966d-aa54-48d3-9526-e22b17200713 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:01.501203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-9dd9720e-fe5d-4f4e-95a0-25e3077da47d req-2502966d-aa54-48d3-9526-e22b17200713 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:01.511902 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-9dd9720e-fe5d-4f4e-95a0-25e3077da47d req-2502966d-aa54-48d3-9526-e22b17200713 service nova] Creating event network-vif-plugged:f6c0dd38-00a0-4528-88f3-dfb525bbed68 for instance c6abf6bf-942d-486d-9129-7f3a756b5252 on hv-cinder-maste Oct 19 22:27:01.517943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-9dd9720e-fe5d-4f4e-95a0-25e3077da47d req-2502966d-aa54-48d3-9526-e22b17200713 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286923 Oct 19 22:27:01.519594 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1937/3870] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:01.837724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:01.838584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:01.849908 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:01.850401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:01.850836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:01.851567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:01.852020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:01.852522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:02.073875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:02.074556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:02.081676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:02.082374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:02.082807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:02.083607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:02.085562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:02.085562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:02.134458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:02.159971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4eed0a88-11eb-4dde-b5f8-75d567cfc437 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.326106 Oct 19 22:27:02.160687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1934/3871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:01 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:02.260022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:02.269600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:02.271442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:02.279101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-37f21027-a77a-4c45-bb37-1b81ed48db1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.208775 Oct 19 22:27:02.279101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1938/3872] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:02 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:27:02.430350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:02.431148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:02.440144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:02.440987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:02.441689 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:02.443029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:02.443816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:02.444467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:02.736274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:02.756040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-481833f3-9ede-43aa-a680-abb8d1a629d0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.323371 Oct 19 22:27:02.757755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1935/3873] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:02 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:03.184034 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:03.184645 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:03.196099 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:03.197433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:03.203568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:03.204566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:03.205189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:03.205778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:03.302464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:03.303156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:03.328782 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:03.331149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:03.331613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:03.332423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:03.332808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:03.333240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:03.420587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:03.430327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7c37c748-9f65-49e6-953e-88aeb51a13e8 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1362 microversion: 2.1 time: 0.250335 Oct 19 22:27:03.433013 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1939/3874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:03 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:03.594902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:03.604458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:03.606268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:03.608020 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-45b6e13d-54d3-4401-be31-187d3bbd7b08 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.312677 Oct 19 22:27:03.609186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1936/3875] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:03 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:27:03.795541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:03.796160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:03.802302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:03.802792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:03.803305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:03.804067 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:03.804515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:03.804934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:03.977070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:03.985829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-fe53ea3a-53fa-44bd-9f54-9cb16c122f20 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.206038 Oct 19 22:27:03.986617 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1940/3876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:03 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:04.455285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:04.457210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:04.466469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:04.468329 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:04.468942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:04.469789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:04.470389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:04.471050 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:04.635303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:04.636463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:04.637948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:04.644541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:04.649329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:04.649329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:04.649329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:04.649329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:04.649605 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:04.649671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7bea8693-a351-4e01-abcb-e5a5ea25e517 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1547 microversion: 2.1 time: 0.197496 Oct 19 22:27:04.649671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1937/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:04 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:04.671840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:04.675734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:04.692306 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:04.693693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:04.694820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:04.698374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:04.699600 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:04.700825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:04.817756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:04.828095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:04.829891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:04.831117 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d4e0debf-f755-446a-a5f6-816b2b1af22e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.201349 Oct 19 22:27:04.842657 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1941/3878] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:04 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:27:04.871052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e28a5b6c-529e-4245-a432-0d23f65efaf2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202677 Oct 19 22:27:04.871978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1938/3879] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 19 22:27:04 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:27:05.009562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:05.010325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:05.017188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:05.017929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:05.018544 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:05.019515 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:05.020246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:05.020729 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:05.314563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:05.322471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b417d532-d8b6-40fb-9bdb-375422ca496a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.317602 Oct 19 22:27:05.326380 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1942/3880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:05 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:05.857621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:05.858567 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:05.866203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:05.866945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:05.867716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:05.869408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:05.870086 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:05.871317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:05.879780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1e70fd69-1acb-4ce5-94b2-aa2373b1787b tempest-TestShelveInstance-389838054 tempest-TestShelveInstance-389838054-project] Action: 'create', calling method: .version_select at 0x7f73366d80d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1298595157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNboMiRSaM4H/GI28KJ+BihWCs/yNijU6OxKgOqE69lrcazL1u4rgdp61Ec4Mbh/3oB4aWCGM0nOiOIaBaRc1wWgEZx2tsfgBkBY7Wv/fatnliKL4LsSTmQ9euyFjRa3fQ=="}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:27:05.897031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-1e70fd69-1acb-4ce5-94b2-aa2373b1787b tempest-TestShelveInstance-389838054 tempest-TestShelveInstance-389838054-project] Getting quotas for project 0b5ba219e7b44b228ed013f830a61572. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:27:05.901893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-1e70fd69-1acb-4ce5-94b2-aa2373b1787b tempest-TestShelveInstance-389838054 tempest-TestShelveInstance-389838054-project] Getting quotas for user 11c2166928f8414f8ae545f7bbd9fd6f and project 0b5ba219e7b44b228ed013f830a61572. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:27:06.006232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1e70fd69-1acb-4ce5-94b2-aa2373b1787b tempest-TestShelveInstance-389838054 tempest-TestShelveInstance-389838054-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.373330 Oct 19 22:27:06.007520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1939/3881] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:27:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:06.347055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:06.348036 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:06.361864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:06.362591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:06.363302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:06.364293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:06.364950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:06.365519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:06.366051 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:06.376276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:06.377982 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:06.379308 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-82564772-12ce-48e9-9e93-889e4d2c8031 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.525629 Oct 19 22:27:06.406215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1943/3882] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:05 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:27:06.508157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-0992845e-b33a-499a-aa7b-6a1ef95f8c78 req-e81d8987-09e7-4e60-ad40-0ac7dc2e33d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6abf6bf-942d-486d-9129-7f3a756b5252", "tag": "f6c0dd38-00a0-4528-88f3-dfb525bbed68"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:27:06.518667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0992845e-b33a-499a-aa7b-6a1ef95f8c78 req-e81d8987-09e7-4e60-ad40-0ac7dc2e33d0 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:06.519171 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0992845e-b33a-499a-aa7b-6a1ef95f8c78 req-e81d8987-09e7-4e60-ad40-0ac7dc2e33d0 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:06.519759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0992845e-b33a-499a-aa7b-6a1ef95f8c78 req-e81d8987-09e7-4e60-ad40-0ac7dc2e33d0 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:06.536102 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-0992845e-b33a-499a-aa7b-6a1ef95f8c78 req-e81d8987-09e7-4e60-ad40-0ac7dc2e33d0 service nova] Creating event network-changed:f6c0dd38-00a0-4528-88f3-dfb525bbed68 for instance c6abf6bf-942d-486d-9129-7f3a756b5252 on hv-cinder-maste Oct 19 22:27:06.545952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-0992845e-b33a-499a-aa7b-6a1ef95f8c78 req-e81d8987-09e7-4e60-ad40-0ac7dc2e33d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039563 Oct 19 22:27:06.547479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1944/3883] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:27:06.652736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:06.664141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f20bdc88-0359-4125-9736-6dfb2b24cd45 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.320863 Oct 19 22:27:06.683478 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1940/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:06 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:06.836709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-1d72f951-29c7-462a-9208-3e2444f8f374 req-54811773-cd43-4a4b-924c-900cbea5675a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1afd0c9-fe0b-4d41-a64e-d8f1e4206920", "name": "network-vif-plugged", "status": "completed", "tag": "579c4679-6968-45b0-9575-4b5c79108416"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:27:06.848610 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1d72f951-29c7-462a-9208-3e2444f8f374 req-54811773-cd43-4a4b-924c-900cbea5675a service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:06.849368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1d72f951-29c7-462a-9208-3e2444f8f374 req-54811773-cd43-4a4b-924c-900cbea5675a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:06.850037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1d72f951-29c7-462a-9208-3e2444f8f374 req-54811773-cd43-4a4b-924c-900cbea5675a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:06.866451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-1d72f951-29c7-462a-9208-3e2444f8f374 req-54811773-cd43-4a4b-924c-900cbea5675a service nova] Creating event network-vif-plugged:579c4679-6968-45b0-9575-4b5c79108416 for instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 on hv-cinder-maste Oct 19 22:27:06.876570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-1d72f951-29c7-462a-9208-3e2444f8f374 req-54811773-cd43-4a4b-924c-900cbea5675a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044420 Oct 19 22:27:06.877181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1945/3885] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:07.405032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:07.405633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:07.416634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:07.417124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:07.417560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:07.418449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:07.419062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:07.419624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:07.611928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:07.624509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:07.626656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:07.628411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c4e379af-60be-45da-99f2-889a79af3f29 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.226791 Oct 19 22:27:07.639079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1941/3886] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:07 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:27:07.691444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:07.692917 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:07.702860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:07.703588 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:07.704199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:07.705152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:07.705756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:07.706357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:07.884894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:07.892755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c3f7e2f-ab5e-48aa-a2cd-39bfe906c8e7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.205593 Oct 19 22:27:07.893325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1946/3887] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:07 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:08.653317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:08.653926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:08.660846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:08.661393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:08.662092 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:08.662796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:08.663278 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:08.666924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:08.806203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:08.816214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:08.817651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:08.818877 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3292f164-2ec8-445d-9974-233a48900009 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.169645 Oct 19 22:27:08.819695 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1942/3888] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:08 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:27:08.893569 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-d361cdfb-517c-4e74-bc60-f5ef9365e8e6 req-83f4169b-4d58-4be0-97c6-9e4052a00d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72787a88-c3f6-432e-9ba6-ebfa6ebadb6e", "name": "network-vif-plugged", "status": "completed", "tag": "228b0721-dbfa-421b-a270-1d3ba83a2f77"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:27:08.908766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-d361cdfb-517c-4e74-bc60-f5ef9365e8e6 req-83f4169b-4d58-4be0-97c6-9e4052a00d1e service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:08.908766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-d361cdfb-517c-4e74-bc60-f5ef9365e8e6 req-83f4169b-4d58-4be0-97c6-9e4052a00d1e service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:08.908766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-d361cdfb-517c-4e74-bc60-f5ef9365e8e6 req-83f4169b-4d58-4be0-97c6-9e4052a00d1e service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:08.916915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:08.917833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-d361cdfb-517c-4e74-bc60-f5ef9365e8e6 req-83f4169b-4d58-4be0-97c6-9e4052a00d1e service nova] Creating event network-vif-plugged:228b0721-dbfa-421b-a270-1d3ba83a2f77 for instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e on hv-cinder-maste Oct 19 22:27:08.918068 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:08.923661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-d361cdfb-517c-4e74-bc60-f5ef9365e8e6 req-83f4169b-4d58-4be0-97c6-9e4052a00d1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033707 Oct 19 22:27:08.924736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1947/3889] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:08.928542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:08.928542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:08.928542 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:08.929125 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:08.929559 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:08.929996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:09.091519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:09.097059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c14b4597-215f-4121-8377-b91d367cc20f tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1366 microversion: 2.1 time: 0.184987 Oct 19 22:27:09.103705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1943/3890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:08 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:27:09.845274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:09.845968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:09.852168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:09.852758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:09.853191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:09.853888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:09.854349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:09.854767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:09.987952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:09.996643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:09.998133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:09.999189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e754c99d-8098-46f6-9fe0-b73de6022d1c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.158284 Oct 19 22:27:09.999744 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1948/3891] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:09 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:27:10.122040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:10.122649 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:10.129029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:10.129507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:10.129943 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:10.130629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:10.131118 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:10.131538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:10.262967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:10.270626 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cb01d3b4-466c-4251-8f15-04bd2536d022 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1556 microversion: 2.1 time: 0.152918 Oct 19 22:27:10.271221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1944/3892] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:27:10 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:27:10.293469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:10.294038 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:10.296075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:10.300793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:10.305024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:10.305024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:10.305024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:10.305024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:10.305315 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:10.384714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ab8e0934-ab2c-4fd6-a104-edf010d5c9aa tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095540 Oct 19 22:27:10.385379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1949/3893] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 19 22:27:10 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:11.024174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:11.024776 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:11.031260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:11.031749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:11.035830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:11.035830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:11.035830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:11.035830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:11.177279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:11.185894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:11.187342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:11.188440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7c67a386-36c6-4dbf-a542-03abea63ce9b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1405 microversion: 2.20 time: 0.168190 Oct 19 22:27:11.189361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1945/3894] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:11 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:27:11.400772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-8ffba98c-5991-44f0-9211-87396e0a1168 req-d6d4de6c-d327-4989-849d-809eac807ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1afd0c9-fe0b-4d41-a64e-d8f1e4206920", "tag": "579c4679-6968-45b0-9575-4b5c79108416"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:27:11.410697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-8ffba98c-5991-44f0-9211-87396e0a1168 req-d6d4de6c-d327-4989-849d-809eac807ecb service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:11.411192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-8ffba98c-5991-44f0-9211-87396e0a1168 req-d6d4de6c-d327-4989-849d-809eac807ecb service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:11.411644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-8ffba98c-5991-44f0-9211-87396e0a1168 req-d6d4de6c-d327-4989-849d-809eac807ecb service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:11.422695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-8ffba98c-5991-44f0-9211-87396e0a1168 req-d6d4de6c-d327-4989-849d-809eac807ecb service nova] Creating event network-changed:579c4679-6968-45b0-9575-4b5c79108416 for instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 on hv-cinder-maste Oct 19 22:27:11.428134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-8ffba98c-5991-44f0-9211-87396e0a1168 req-d6d4de6c-d327-4989-849d-809eac807ecb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031666 Oct 19 22:27:11.428818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1950/3895] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:12.215458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:12.216075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:12.224372 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:12.228165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:12.228165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:12.228165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:12.228165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:12.228603 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:12.382984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:12.392540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:12.393988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:27:12.395232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-406900d6-7d5a-4153-bc53-6bd7040d2b7e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1598 microversion: 2.20 time: 0.184265 Oct 19 22:27:12.395830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1946/3896] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:27:12 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:27:12.421305 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:12.421870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:12.437941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:12.438432 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:12.438863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:12.439578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:12.440025 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:12.440443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:12.520137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-79209173-a813-4cf8-85fa-09779088a3ca tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103676 Oct 19 22:27:12.520732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1951/3897] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Oct 19 22:27:12 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:27:13.501497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-aace85fd-4b84-43de-8258-6adca4388acf req-5bb81b6f-8639-41e6-8ced-980621f9b526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72787a88-c3f6-432e-9ba6-ebfa6ebadb6e", "tag": "228b0721-dbfa-421b-a270-1d3ba83a2f77"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:27:13.511225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-aace85fd-4b84-43de-8258-6adca4388acf req-5bb81b6f-8639-41e6-8ced-980621f9b526 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:13.511699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-aace85fd-4b84-43de-8258-6adca4388acf req-5bb81b6f-8639-41e6-8ced-980621f9b526 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:13.512123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-aace85fd-4b84-43de-8258-6adca4388acf req-5bb81b6f-8639-41e6-8ced-980621f9b526 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:13.524893 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-aace85fd-4b84-43de-8258-6adca4388acf req-5bb81b6f-8639-41e6-8ced-980621f9b526 service nova] Creating event network-changed:228b0721-dbfa-421b-a270-1d3ba83a2f77 for instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e on hv-cinder-maste Oct 19 22:27:13.530583 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-aace85fd-4b84-43de-8258-6adca4388acf req-5bb81b6f-8639-41e6-8ced-980621f9b526 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Oct 19 22:27:13.531237 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1947/3898] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:42.860633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=5 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:42.861469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=67 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:42.865464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:42.868084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:42.872345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:42.872817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:42.873249 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:42.873923 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:42.874367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:42.874784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:42.898808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-506a9086-f572-4aff-ac0e-b8d845750153 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252/ips" status: 200 len: 144 microversion: 2.1 time: 0.039834 Oct 19 22:27:42.899391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1952/3899] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:27:42 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:47.623817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=4 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:47.624964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:47.625605 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=89 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:27:47.629670 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:47.630295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:47.636222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:47.636693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:47.637121 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:47.637794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:47.638238 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:47.638656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:47.661232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ade933e1-4699-48ec-b35e-4a21a8c9a8d3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/ips" status: 200 len: 149 microversion: 2.1 time: 0.038985 Oct 19 22:27:47.665811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1948/3900] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:27:47 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:27:49.724655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:27:49.725127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:27:49.731103 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:49.731575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:49.732003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:49.732678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:27:49.733126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:27:49.733543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:27:49.756419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91709691-616a-47cc-8f26-81c10fb0e058 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/ips" status: 200 len: 152 microversion: 2.20 time: 0.148733 Oct 19 22:27:49.756940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1953/3901] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Oct 19 22:27:49 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/ips => generated 152 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:28:09.410745 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3affb752-a29a-445b-94e6-86630663db95 tempest-TestShelveInstance-389838054 tempest-TestShelveInstance-389838054-project] Calling method '.version_select at 0x7f7332b77700>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:09.497299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3affb752-a29a-445b-94e6-86630663db95 tempest-TestShelveInstance-389838054 tempest-TestShelveInstance-389838054-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1298595157" status: 202 len: 0 microversion: 2.1 time: 0.091171 Oct 19 22:28:09.497882 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1949/3902] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Oct 19 22:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1298595157 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:28:30.822898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:28:30.823802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=8 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:28:30.996648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-02e53e3e-dc95-4d21-8ed7-3c0eee1ac438 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Action: 'create', calling method: .version_select at 0x7f73364893a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1174103779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8OKGVHtFFnsbcn8OfFxjkEDpJuPRyqB0VVEjNZYsJMlnAKGw1maewXrcJDgDT2VyMvuv8qBCfdjuRud8ATPU2EZqEq0RPYG86PG/23KMpCkSKSr+Gqz/NP656wLQOZ1Q=="}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:28:31.013330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-02e53e3e-dc95-4d21-8ed7-3c0eee1ac438 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for project 9b8d72b42f384b4a9933c4648913857c. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:28:31.017871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-02e53e3e-dc95-4d21-8ed7-3c0eee1ac438 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for user 690632c6d7494c22997ac41257ad32ff and project 9b8d72b42f384b4a9933c4648913857c. Resources: {'key_pairs'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:28:31.109037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-02e53e3e-dc95-4d21-8ed7-3c0eee1ac438 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.295625 Oct 19 22:28:31.109650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1954/3903] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:28:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:28:42.975399 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:42.975962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:28:42.979803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=4 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:28:42.980439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:28:42.985133 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:42.985703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:42.986142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:42.986839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:42.987318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:42.987770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:43.014853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:28:43.342024 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-195f1cc9-933f-4c92-b0e9-9aa4ec5e1e13 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 204 len: 0 microversion: 2.1 time: 0.370943 Oct 19 22:28:43.342614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1950/3904] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:28:42 2022] DELETE /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:28:43.348180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:28:43.348924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:28:43.352764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:43.353366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:28:43.359881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:43.360359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:43.360793 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:43.361471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:43.361915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:43.362376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:43.559449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:28:43.569921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ad3cc54c-61ca-4e44-aec4-bb09369b1699 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1671 microversion: 2.1 time: 0.223065 Oct 19 22:28:43.570619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1955/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:28:43 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:28:44.597713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:44.598417 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:28:44.605659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:44.606180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:44.606574 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:44.607310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:44.607820 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:44.608295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:45.094505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:28:45.105233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-30119daa-ec68-4de1-aade-a2a1597eb2a2 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1671 microversion: 2.1 time: 0.515172 Oct 19 22:28:45.106299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1951/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:28:44 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:28:45.309797 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-0a2b0a0a-615b-4a5a-bd1f-33353f5b3697 req-ae84c9bf-8d6b-405b-918c-fd4ee606bd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9df3c36-da16-4a07-b4a2-c426787bd720", "name": "network-vif-deleted", "tag": "153fb256-a786-4d57-9050-0204c6241145"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:28:45.324720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0a2b0a0a-615b-4a5a-bd1f-33353f5b3697 req-ae84c9bf-8d6b-405b-918c-fd4ee606bd4f service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:45.325307 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0a2b0a0a-615b-4a5a-bd1f-33353f5b3697 req-ae84c9bf-8d6b-405b-918c-fd4ee606bd4f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:45.325739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-0a2b0a0a-615b-4a5a-bd1f-33353f5b3697 req-ae84c9bf-8d6b-405b-918c-fd4ee606bd4f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:45.338771 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-0a2b0a0a-615b-4a5a-bd1f-33353f5b3697 req-ae84c9bf-8d6b-405b-918c-fd4ee606bd4f service nova] Creating event network-vif-deleted:153fb256-a786-4d57-9050-0204c6241145 for instance a9df3c36-da16-4a07-b4a2-c426787bd720 on hv-cinder-maste Oct 19 22:28:45.344057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-0a2b0a0a-615b-4a5a-bd1f-33353f5b3697 req-ae84c9bf-8d6b-405b-918c-fd4ee606bd4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043757 Oct 19 22:28:45.344850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1956/3907] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:28:45.877044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-7a6a32bf-c67a-4f63-8c28-e4644d0dde92 req-e70eb815-4fcb-4d89-9f7b-b1ef1e678908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6abf6bf-942d-486d-9129-7f3a756b5252", "name": "network-vif-deleted", "tag": "f6c0dd38-00a0-4528-88f3-dfb525bbed68"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:28:45.899635 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7a6a32bf-c67a-4f63-8c28-e4644d0dde92 req-e70eb815-4fcb-4d89-9f7b-b1ef1e678908 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:45.900110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7a6a32bf-c67a-4f63-8c28-e4644d0dde92 req-e70eb815-4fcb-4d89-9f7b-b1ef1e678908 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:45.900531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7a6a32bf-c67a-4f63-8c28-e4644d0dde92 req-e70eb815-4fcb-4d89-9f7b-b1ef1e678908 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:45.914858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-7a6a32bf-c67a-4f63-8c28-e4644d0dde92 req-e70eb815-4fcb-4d89-9f7b-b1ef1e678908 service nova] Creating event network-vif-deleted:f6c0dd38-00a0-4528-88f3-dfb525bbed68 for instance c6abf6bf-942d-486d-9129-7f3a756b5252 on hv-cinder-maste Oct 19 22:28:45.921548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-7a6a32bf-c67a-4f63-8c28-e4644d0dde92 req-e70eb815-4fcb-4d89-9f7b-b1ef1e678908 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049151 Oct 19 22:28:45.926243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1952/3908] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:28:46.129963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:46.130674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:28:46.137490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:46.137981 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:46.145863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:46.145863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:46.145863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:46.145863 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:46.213574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ae13baf5df84b588fa65e8dffec4bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2caa701e503b44ddb9fbe09d36a53853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:28:46.225402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91ab1d81-6e69-48c5-9b4f-ea66cc7a8544 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 200 len: 1321 microversion: 2.1 time: 0.100155 Oct 19 22:28:46.242675 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1957/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:28:46 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 1321 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:28:47.432743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:47.432743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:28:47.438696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:47.439305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:47.439971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:47.440771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:47.441352 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:47.441823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:47.455767 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] HTTP exception thrown: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Request method failure captured: Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 HTTP/1.1 Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHRBZCUmxZMGyp74xzPL8pZjFNful5ZnUIy7kQy7kPy92RK0G6BOTCE6oHzrqGBPEL__EC94bUZSpnok4cCZtiBLbHuDC74Ky8eZXcv9Wr4OwdtR16QwNB5LTADBBwPySLngw90oYwmOVbc7z_xbso88Rs0Yg6NrgPlfN_y1DY0giis Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:28:47.457446 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}] Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 5ae13baf5df84b588fa65e8dffec4bbf Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:47.458737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'c6abf6bf-942d-486d-9129-7f3a756b5252'} Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:28:47.463232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:47.464502 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:47.465614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Returning 404 to user: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:28:47.465614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-23853f4d-0ef6-46bc-a9bd-661d36e1a0f9 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 404 len: 111 microversion: 2.1 time: 0.212930 Oct 19 22:28:47.465614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1953/3910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:28:47 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:28:47.467764 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-09086449-b64b-43a0-aa0f-919e1487b91c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '.version_select at 0x7f733656a8b0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:47.571696 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-09086449-b64b-43a0-aa0f-919e1487b91c tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894525925" status: 202 len: 0 microversion: 2.1 time: 0.107645 Oct 19 22:28:47.572273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1958/3911] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 19 22:28:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894525925 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:28:48.304913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:48.305406 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:28:48.311874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:48.312351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:48.312779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:48.313487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:48.313935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:48.314350 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:48.328239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] HTTP exception thrown: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Request method failure captured: Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 HTTP/1.1 Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHRBZCUmxZMGyp74xzPL8pZjFNful5ZnUIy7kQy7kPy92RK0G6BOTCE6oHzrqGBPEL__EC94bUZSpnok4cCZtiBLbHuDC74Ky8eZXcv9Wr4OwdtR16QwNB5LTADBBwPySLngw90oYwmOVbc7z_xbso88Rs0Yg6NrgPlfN_y1DY0giis Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:28:48.329784 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}] Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 5ae13baf5df84b588fa65e8dffec4bbf Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.331189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'c6abf6bf-942d-486d-9129-7f3a756b5252'} Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:28:48.331904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.333333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.334550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Returning 404 to user: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:28:48.334550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b1f760e7-6446-4863-ba9b-8abde4b73eda tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 404 len: 111 microversion: 2.1 time: 0.030140 Oct 19 22:28:48.334550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1954/3912] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:28:48 2022] DELETE /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:28:48.339713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:28:48.340366 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: c6abf6bf-942d-486d-9129-7f3a756b5252] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:28:48.347346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:48.347832 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:48.348260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:48.348931 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:28:48.349379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:28:48.349798 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:28:48.363844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] HTTP exception thrown: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Request method failure captured: Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 HTTP/1.1 Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHRBZCUmxZMGyp74xzPL8pZjFNful5ZnUIy7kQy7kPy92RK0G6BOTCE6oHzrqGBPEL__EC94bUZSpnok4cCZtiBLbHuDC74Ky8eZXcv9Wr4OwdtR16QwNB5LTADBBwPySLngw90oYwmOVbc7z_xbso88Rs0Yg6NrgPlfN_y1DY0giis Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:28:48.365596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}] Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 5ae13baf5df84b588fa65e8dffec4bbf Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.366906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': 'c6abf6bf-942d-486d-9129-7f3a756b5252'} Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:28:48.367683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. Oct 19 22:28:48.369079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:28:48.370149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Returning 404 to user: Instance c6abf6bf-942d-486d-9129-7f3a756b5252 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:28:48.370149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0f4c1cb3-3ee9-4f04-8119-02d28b8e8725 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252" status: 404 len: 111 microversion: 2.1 time: 0.031248 Oct 19 22:28:48.370149 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1959/3913] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:28:48 2022] GET /compute/v2.1/servers/c6abf6bf-942d-486d-9129-7f3a756b5252 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:36:36.454110 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abd2e8e2-8688-4929-98e6-329b3b6fa1e3"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:36.457862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:36.467318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10834d57-2de5-4ec5-8d0f-11914d1788a7] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 22:36:36.468069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:36.470016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:36.471656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:36:36.471895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:36:36.473183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:36:36.473515 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:36:36.475528 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:36:36.476014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments (ip 10.222.0.20) !!! Oct 19 22:36:36.478394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:36.479378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:36.480221 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:36.481060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:36.481612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:36.482134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:37.112644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fed87e8-26b4-410b-8455-b08e38f2b579] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 22:36:37.115113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:37.116108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=16 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:37.117039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:36:37.117337 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/action (ip 10.222.0.20) !!! Oct 19 22:36:37.119247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:36:37.119385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/action (ip 10.222.0.20) !!! Oct 19 22:36:37.120383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:36:37.120493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/action (ip 10.222.0.20) !!! Oct 19 22:36:37.126302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:37.127108 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:37.138196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:37.138686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:37.139157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:37.139871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:37.140322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:37.140748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:37.171098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lazy-loading 'flavor' on Instance uuid 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:36:37.475760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] [10834d57-2de5-4ec5-8d0f-11914d1788a7] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42258. Oct 19 22:36:37.742174 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9b261eb4-2236-44c6-a2aa-aa8284b904fc tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/action" status: 202 len: 0 microversion: 2.20 time: 0.631215 Oct 19 22:36:37.742766 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1960/3914] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 19 22:36:37 2022] POST /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 22:36:37.751611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:37.752295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:37.758498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:37.758997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:37.759433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:37.760111 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:37.760627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:37.761053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:37.896132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:37.904575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:37.906023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:37.907333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e54e97e8-6fd1-4bac-b3f6-af4003ab745f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.159610 Oct 19 22:36:37.908057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1961/3915] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:37 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:37.947087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1d1c5c2c-00e1-4171-8408-a7449a0f5fc7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.509372 Oct 19 22:36:37.947691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1955/3916] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:36:36 2022] POST /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments => generated 194 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:36:38.932448 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:38.933109 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:38.942173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:38.944445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:38.944445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:38.944445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:38.944445 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:38.944782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:38.950943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fed87e8-26b4-410b-8455-b08e38f2b579] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42288. Oct 19 22:36:39.087983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:39.092994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:39.094444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:39.095636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9201e21b-0c2b-4055-ba44-231880490d2a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.167064 Oct 19 22:36:39.096196 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1962/3917] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:38 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:40.123136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:40.123136 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:40.128819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:40.129307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:40.129749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:40.130439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:40.130927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:40.133098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:40.273234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:40.281954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:40.283402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:40.284544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9f4e50da-17d5-494d-b9d3-d6dafc96fcbd tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.167243 Oct 19 22:36:40.285103 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1956/3918] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:40 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:41.309319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:41.309916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:41.316350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:41.316824 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:41.317253 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:41.318016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:41.318434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:41.318851 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:41.560238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:41.569552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:41.579527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:41.579527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-855aacd9-9d43-4f13-be31-84c60c4fe5a7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.267186 Oct 19 22:36:41.579527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1963/3919] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:41 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:41.579959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-10d7106c-1812-4136-8b57-efb9af6d136b req-b48d42b1-5532-4c7a-a3f9-3710f8692172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4d839a-a9cb-470c-b01b-b634c0057dd2", "name": "network-vif-deleted", "tag": "c43f1a07-3986-4753-ac98-ab6d29e96671"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:41.586441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-10d7106c-1812-4136-8b57-efb9af6d136b req-b48d42b1-5532-4c7a-a3f9-3710f8692172 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:41.587006 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-10d7106c-1812-4136-8b57-efb9af6d136b req-b48d42b1-5532-4c7a-a3f9-3710f8692172 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:41.587494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-10d7106c-1812-4136-8b57-efb9af6d136b req-b48d42b1-5532-4c7a-a3f9-3710f8692172 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:41.600215 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-10d7106c-1812-4136-8b57-efb9af6d136b req-b48d42b1-5532-4c7a-a3f9-3710f8692172 service nova] Creating event network-vif-deleted:c43f1a07-3986-4753-ac98-ab6d29e96671 for instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 on hv-cinder-maste Oct 19 22:36:41.605452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-10d7106c-1812-4136-8b57-efb9af6d136b req-b48d42b1-5532-4c7a-a3f9-3710f8692172 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093750 Oct 19 22:36:41.606114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1957/3920] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:36:42.602666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:42.603918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:42.618685 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:42.619252 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:42.619689 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:42.620679 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:42.621897 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:42.622535 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:42.827916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-68507b2e-6445-4fe9-9078-d9d2006985d5 req-2c910801-7a5b-4ea2-8a0c-4205ae8f8942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e9edcd-9575-4a90-80cc-d85cdee02841", "name": "network-vif-deleted", "tag": "e051fbf4-32c1-4b85-955d-8a066702c318"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:42.837736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-68507b2e-6445-4fe9-9078-d9d2006985d5 req-2c910801-7a5b-4ea2-8a0c-4205ae8f8942 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:42.838467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-68507b2e-6445-4fe9-9078-d9d2006985d5 req-2c910801-7a5b-4ea2-8a0c-4205ae8f8942 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:42.839193 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-68507b2e-6445-4fe9-9078-d9d2006985d5 req-2c910801-7a5b-4ea2-8a0c-4205ae8f8942 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:42.854202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-68507b2e-6445-4fe9-9078-d9d2006985d5 req-2c910801-7a5b-4ea2-8a0c-4205ae8f8942 service nova] Creating event network-vif-deleted:e051fbf4-32c1-4b85-955d-8a066702c318 for instance 36e9edcd-9575-4a90-80cc-d85cdee02841 on hv-cinder-maste Oct 19 22:36:42.857165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-68507b2e-6445-4fe9-9078-d9d2006985d5 req-2c910801-7a5b-4ea2-8a0c-4205ae8f8942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094432 Oct 19 22:36:42.857760 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1958/3921] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:36:42.930782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:42.959098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:42.965854 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:42.967126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b04102b1-a432-4dac-b465-4b71daa1f4c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.369068 Oct 19 22:36:42.967861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1964/3922] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:42 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:43.140540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-948799883", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174103779", "security_groups": [{"name": "tempest-secgroup-smoke-309554937"}], "block_device_mapping_v2": [{"uuid": "2747d8bc-6665-4b8e-8aad-1f44df889afe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bde96250-97af-4607-a230-ada090eb596a"}]}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:43.274580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] validate_networks() for [('bde96250-97af-4607-a230-ada090eb596a', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:36:44.000330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:44.001776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:44.010209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.010704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.011192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.012026 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.012550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.012983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.019539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:36:44.020666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:36:44.021517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:36:44.023497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:36:44.024155 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:36:44.035235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.036094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.037105 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.037944 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.038529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.039272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.057898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for project 9b8d72b42f384b4a9933c4648913857c. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:36:44.062915 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for user 690632c6d7494c22997ac41257ad32ff and project 9b8d72b42f384b4a9933c4648913857c. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:36:44.123316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:36:44.125752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2747d8bc-6665-4b8e-8aad-1f44df889afe',volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:36:44.174716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:44.190765 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:44.198256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:44.201309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1712a527-ab17-4a40-8f17-12224baad143 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.210095 Oct 19 22:36:44.202376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1965/3923] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:43 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:36:44.210321 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:44.212525 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:44.218926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.219622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.220229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.221375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.222181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.222922 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.238256 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] HTTP exception thrown: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Request method failure captured: Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 HTTP/1.1 Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHRBZCUmxZMGyp74xzPL8pZjFNful5ZnUIy7kQy7kPy92RK0G6BOTCE6oHzrqGBPEL__EC94bUZSpnok4cCZtiBLbHuDC74Ky8eZXcv9Wr4OwdtR16QwNB5LTADBBwPySLngw90oYwmOVbc7z_xbso88Rs0Yg6NrgPlfN_y1DY0giis Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:36:44.240028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}] Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 5ae13baf5df84b588fa65e8dffec4bbf Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.241465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '8fefc135-201b-453b-a232-37a012534b45'} Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:36:44.242291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.247718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.248994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Returning 404 to user: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:36:44.248994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed5abb32-9188-4ddb-91ac-f24ea4478634 tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 404 len: 111 microversion: 2.1 time: 0.038574 Oct 19 22:36:44.248994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1966/3924] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:36:44 2022] DELETE /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:36:44.253189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:44.253852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] [instance: 8fefc135-201b-453b-a232-37a012534b45] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:44.260019 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.260523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.261155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.261870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.262333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.262774 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.277267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] HTTP exception thrown: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Request method failure captured: Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 HTTP/1.1 Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHRBZCUmxZMGyp74xzPL8pZjFNful5ZnUIy7kQy7kPy92RK0G6BOTCE6oHzrqGBPEL__EC94bUZSpnok4cCZtiBLbHuDC74Ky8eZXcv9Wr4OwdtR16QwNB5LTADBBwPySLngw90oYwmOVbc7z_xbso88Rs0Yg6NrgPlfN_y1DY0giis Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:36:44.279381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2caa701e503b44ddb9fbe09d36a53853"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2caa701e503b44ddb9fbe09d36a53853"}]}] Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 2caa701e503b44ddb9fbe09d36a53853 Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1492521216 Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 5ae13baf5df84b588fa65e8dffec4bbf Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeTestJSON-1492521216-project Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.280627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '8fefc135-201b-453b-a232-37a012534b45'} Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:36:44.281226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. Oct 19 22:36:44.282442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:44.283408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] Returning 404 to user: Instance 8fefc135-201b-453b-a232-37a012534b45 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:36:44.283408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-56f77166-ae94-41b9-ac46-24d862277e7e tempest-AttachVolumeTestJSON-1492521216 tempest-AttachVolumeTestJSON-1492521216-project] 10.222.0.20 "GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45" status: 404 len: 111 microversion: 2.1 time: 0.033858 Oct 19 22:36:44.283408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1967/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:44 2022] GET /compute/v2.1/servers/8fefc135-201b-453b-a232-37a012534b45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 22:36:44.585495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-04ce9627-9069-4c31-b13a-f201b3bb8a08 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.451258 Oct 19 22:36:44.593063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1959/3926] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:36:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:36:44.598693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d3900ee-1276-4b12-a92c-20b8c6165dc9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:44.599251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d3900ee-1276-4b12-a92c-20b8c6165dc9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:44.687331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9d3900ee-1276-4b12-a92c-20b8c6165dc9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:44.698458 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d3900ee-1276-4b12-a92c-20b8c6165dc9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1094 microversion: 2.1 time: 0.103475 Oct 19 22:36:44.712988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1968/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:44 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:44.891239 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-6f58769f-be71-439d-8da9-ad715dc1268d req-ad5bd41c-6f16-48b6-aeb9-c2155ba8cd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3772e1d-c468-46b9-95cf-d21bb0e427b6", "name": "network-vif-deleted", "tag": "7db273b8-393f-4339-88f8-17078884c016"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:44.901863 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6f58769f-be71-439d-8da9-ad715dc1268d req-ad5bd41c-6f16-48b6-aeb9-c2155ba8cd34 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:44.902395 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6f58769f-be71-439d-8da9-ad715dc1268d req-ad5bd41c-6f16-48b6-aeb9-c2155ba8cd34 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:44.902851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6f58769f-be71-439d-8da9-ad715dc1268d req-ad5bd41c-6f16-48b6-aeb9-c2155ba8cd34 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:44.914186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-6f58769f-be71-439d-8da9-ad715dc1268d req-ad5bd41c-6f16-48b6-aeb9-c2155ba8cd34 service nova] Creating event network-vif-deleted:7db273b8-393f-4339-88f8-17078884c016 for instance c3772e1d-c468-46b9-95cf-d21bb0e427b6 on hv-cinder-maste Oct 19 22:36:44.919282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-6f58769f-be71-439d-8da9-ad715dc1268d req-ad5bd41c-6f16-48b6-aeb9-c2155ba8cd34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032911 Oct 19 22:36:44.920023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1960/3928] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:36:45.230802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:45.231509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:45.248078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:45.248579 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:45.249020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:45.249920 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:45.250382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:45.250812 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:45.462088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:45.473589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:45.475170 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:45.476388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1793730a-3125-4b24-9cb8-8f3ead19941c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.249549 Oct 19 22:36:45.476937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1969/3929] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:45 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:45.724557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3ee12a9c-a8bd-47cb-9eb2-3476a49d9ff3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:45.725307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3ee12a9c-a8bd-47cb-9eb2-3476a49d9ff3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:45.795853 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3ee12a9c-a8bd-47cb-9eb2-3476a49d9ff3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:45.804864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3ee12a9c-a8bd-47cb-9eb2-3476a49d9ff3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1094 microversion: 2.1 time: 0.084339 Oct 19 22:36:45.805952 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1961/3930] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:45 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:46.505349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:46.505961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:46.525331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:46.527662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:46.528371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:46.531388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:46.531891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:46.532332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:46.828256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:46.833816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:46.836992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:46.837957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:46.838611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:46.839822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:46.840566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:46.841189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:46.919492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:46.929718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-23632e59-a3ed-4fec-bee9-4ce128361949 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1192 microversion: 2.1 time: 0.105909 Oct 19 22:36:46.930618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1962/3931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:46 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1192 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:36:47.081788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:47.090262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:47.091926 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:47.093179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-02a85c7d-2a57-4705-85f9-d8fc0a5c3de7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.591915 Oct 19 22:36:47.093823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1970/3932] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:46 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:47.953973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:47.954531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:47.961333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:47.962321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:47.962881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:47.965208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:47.965870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:47.966489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:48.070729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:48.101891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-b8af2ed0-f503-439c-aa37-50eb1bd2a0f5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1210 microversion: 2.1 time: 0.152688 Oct 19 22:36:48.102800 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1963/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:47 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1210 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:48.125331 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:48.126192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:48.138748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:48.139301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:48.140192 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:48.140948 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:48.141405 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:48.141844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:48.343074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:48.352190 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:48.354009 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:48.355373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-06dbc6a5-0360-4819-910c-d9a1e7c02110 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.234565 Oct 19 22:36:48.357218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1971/3934] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:48 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:49.131132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:49.131827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:49.150975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:49.153514 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:49.154550 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:49.155374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:49.155913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:49.156211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:49.386429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:49.388306 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:49.402727 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:49.403584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:49.404240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:49.405072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:49.405716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:49.406583 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:49.479196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:49.491858 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e62746dd-7f4f-4e22-bd5f-08b4f845b1cd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1277 microversion: 2.1 time: 0.366113 Oct 19 22:36:49.495455 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1964/3935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:49 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1277 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:49.645739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:49.648152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:49.649994 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:49.651928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9b05f9e8-1a8b-46d7-ae05-82d7b4583a94 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.273884 Oct 19 22:36:49.652539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1972/3936] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:49 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:36:50.179153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-7e8384e7-5ab9-4aff-b5f2-173fab235f60 req-1d5eaa27-71e5-4b6f-a7e0-3677882a6c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd41f7ab-aba7-42df-b4a3-b4c3009c4920", "tag": "7a6d435c-73c6-46f6-ba71-be435a81e2dc"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:50.203153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7e8384e7-5ab9-4aff-b5f2-173fab235f60 req-1d5eaa27-71e5-4b6f-a7e0-3677882a6c86 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.203153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7e8384e7-5ab9-4aff-b5f2-173fab235f60 req-1d5eaa27-71e5-4b6f-a7e0-3677882a6c86 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.203153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-7e8384e7-5ab9-4aff-b5f2-173fab235f60 req-1d5eaa27-71e5-4b6f-a7e0-3677882a6c86 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.230682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-7e8384e7-5ab9-4aff-b5f2-173fab235f60 req-1d5eaa27-71e5-4b6f-a7e0-3677882a6c86 service nova] Creating event network-changed:7a6d435c-73c6-46f6-ba71-be435a81e2dc for instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 on hv-cinder-maste Oct 19 22:36:50.241920 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-7e8384e7-5ab9-4aff-b5f2-173fab235f60 req-1d5eaa27-71e5-4b6f-a7e0-3677882a6c86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067975 Oct 19 22:36:50.242534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1965/3937] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:36:50.309533 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abd2e8e2-8688-4929-98e6-329b3b6fa1e3"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:50.315427 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:50.323782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.324539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.325231 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.326367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.327574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.328015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.545541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Invalid volume: volume abd2e8e2-8688-4929-98e6-329b3b6fa1e3 is already attached to instances: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 Oct 19 22:36:50.546613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:50.546613 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: POST /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments HTTP/1.1 Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 74 Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:36:50.547115 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {"volumeAttachment": {"volumeId": "abd2e8e2-8688-4929-98e6-329b3b6fa1e3"}} Oct 19 22:36:50.548479 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Invalid volume: volume abd2e8e2-8688-4929-98e6-329b3b6fa1e3 is already attached to instances: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'server_id': 'f1afd0c9-fe0b-4d41-a64e-d8f1e4206920', 'body': {'volumeAttachment': {'volumeId': 'abd2e8e2-8688-4929-98e6-329b3b6fa1e3'}}} Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume abd2e8e2-8688-4929-98e6-329b3b6fa1e3 is already attached to instances: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:50.549172 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume abd2e8e2-8688-4929-98e6-329b3b6fa1e3 is already attached to instances: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:50.550276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume abd2e8e2-8688-4929-98e6-329b3b6fa1e3 is already attached to instances: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 400 to user: Invalid volume: volume abd2e8e2-8688-4929-98e6-329b3b6fa1e3 is already attached to instances: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1d36abfd-a770-42d7-9208-9a6fffbf09c7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.225618 Oct 19 22:36:50.551609 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1973/3938] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:36:50 2022] POST /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments => generated 174 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:36:50.552348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.552348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.552348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.552348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.552816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.552816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.620077 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:50.620822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:50.627552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.628348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.629008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.629929 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.630658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.631302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.722015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'services' on Instance uuid f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:36:50.757151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:50.771754 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-96a261a6-f0b0-4896-9913-16d07af43464 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1277 microversion: 2.1 time: 0.257306 Oct 19 22:36:50.791094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1966/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:50 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:50.792959 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:50.797562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:50.804108 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.804588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.805014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.805892 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:50.806628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:50.807083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:50.962926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:50.977223 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:50.981355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8c3e26a7-b07c-4776-ad34-533a0350a0ef tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments/abd2e8e2-8688-4929-98e6-329b3b6fa1e3" status: 202 len: 0 microversion: 2.1 time: 0.361168 Oct 19 22:36:50.981355 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1974/3940] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:36:50 2022] DELETE /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments/abd2e8e2-8688-4929-98e6-329b3b6fa1e3 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 22:36:50.981590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:50.981590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-171c0567-8740-499f-b29c-8fe3b84bfeab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.204764 Oct 19 22:36:50.982995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1967/3941] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:50 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:50.987942 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:51.000202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:51.015389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:51.015389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:51.015389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:51.015389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:51.015708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:51.015708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:51.050404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2e8b9255-7d3b-4037-bb11-210fc482e37c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066923 Oct 19 22:36:51.050976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1975/3942] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:36:50 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:36:51.805436 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:51.806568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:51.814351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:51.814835 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:51.815328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:51.820349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:51.820349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:51.820349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:51.963630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:51.975313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6af9cf44-3641-491c-83d6-a4da50e1f883 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.174736 Oct 19 22:36:51.987230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1968/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:51 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:52.014566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:52.019000 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:52.032630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:52.035215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:52.036383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:52.037346 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:52.038260 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:52.038856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:52.044918 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:52.069838 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:52.081841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:52.094362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:52.094362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:52.094661 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:52.096825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:52.097629 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:52.098720 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:52.151955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-198ed488-68b6-452e-9b3b-d7e53ad7891a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092077 Oct 19 22:36:52.153287 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1969/3944] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:36:52 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:36:52.492604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:52.501294 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:52.502733 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:52.503921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dd46a535-70cf-4862-9eb8-811c0c65354a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.499478 Oct 19 22:36:52.504631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1976/3945] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:52 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:36:53.009026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:53.009026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:53.009026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.009026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.009699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.009699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.009699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.009699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.157590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:53.164912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:53.168276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-45fd3d96-8065-46cf-a466-43717d0a9f1c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.171972 Oct 19 22:36:53.168506 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:53.169849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1970/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:52 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:36:53.186561 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.187091 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.187526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.188348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.188967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.189391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.227543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-21af7828-1c95-450b-be0f-81bb4b9206ec tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066793 Oct 19 22:36:53.228614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1977/3947] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:36:53 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 22:36:53.307814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:53.308312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:53.314697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.315205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.315637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.316314 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.316765 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.317378 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.344061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:36:53.530728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:53.531376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:53.537151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.537634 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.538065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.538743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.539227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.539646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.696974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:53.708054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:53.710433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:53.712577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0800a58a-4cca-45b2-9e60-7733de291151 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1743 microversion: 2.20 time: 0.186401 Oct 19 22:36:53.713590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1978/3948] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:53 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:53.732818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5fe93995-d07d-46c7-a4d2-c5f627915621 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 204 len: 0 microversion: 2.1 time: 0.428505 Oct 19 22:36:53.733413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1971/3949] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:36:53 2022] DELETE /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:36:53.745060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:53.745878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:53.754417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.755114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.755740 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.756584 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:53.757185 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:53.757748 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:53.913853 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:53.924732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e52b4b8c-c67d-40ac-97a8-044f72f26d7c tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1680 microversion: 2.1 time: 0.183051 Oct 19 22:36:53.925608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1979/3950] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:53 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:54.194151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:54.194928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:54.197408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:54.203470 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:54.204044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:54.204544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:54.205296 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:54.205825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:54.206244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:54.376981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:54.380563 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:54.385192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-453bf2ee-d24f-4ee8-bb08-75ac1ae9a9c3 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.195247 Oct 19 22:36:54.385770 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1972/3951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:54 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:54.747147 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:54.747787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:54.750202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:54.754985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:54.755473 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:54.755908 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:54.756587 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:54.757041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:54.757513 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:54.949771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:54.950808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:54.958724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:54.959343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:54.959849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:54.960612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:54.961344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:54.961783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:54.999807 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:55.009940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:55.012309 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:55.013999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ee453ff0-abdc-4c7c-bfd2-f51f95608a1f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1743 microversion: 2.20 time: 0.271147 Oct 19 22:36:55.015664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1980/3952] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:54 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1743 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:55.148978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:55.156799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa080d45-e86c-4803-b90d-d99950f09167 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1680 microversion: 2.1 time: 0.211851 Oct 19 22:36:55.157369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1973/3953] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:54 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:55.417835 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:55.420297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:55.441161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:55.441677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:55.442123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:55.445730 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:55.446666 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:55.447176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:55.768593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:55.777303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-49961ade-8ea0-49f6-981f-f5cdc1695a6c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.372142 Oct 19 22:36:55.778304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1981/3954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:55 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:55.804895 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=8 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:36:56.041308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-e8d1de99-5d13-4f7a-9f6c-c3653ecb10c2 req-4571161d-f171-41e3-8e35-1650a123c5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72787a88-c3f6-432e-9ba6-ebfa6ebadb6e", "name": "network-vif-plugged", "status": "completed", "tag": "228b0721-dbfa-421b-a270-1d3ba83a2f77"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:56.042547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:56.044559 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:56.051209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.054068 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.054859 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:56.055717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.056265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.056708 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:56.080079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e8d1de99-5d13-4f7a-9f6c-c3653ecb10c2 req-4571161d-f171-41e3-8e35-1650a123c5da service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.082849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e8d1de99-5d13-4f7a-9f6c-c3653ecb10c2 req-4571161d-f171-41e3-8e35-1650a123c5da service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.083737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-e8d1de99-5d13-4f7a-9f6c-c3653ecb10c2 req-4571161d-f171-41e3-8e35-1650a123c5da service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:56.110159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-e8d1de99-5d13-4f7a-9f6c-c3653ecb10c2 req-4571161d-f171-41e3-8e35-1650a123c5da service nova] Creating event network-vif-plugged:228b0721-dbfa-421b-a270-1d3ba83a2f77 for instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e on hv-cinder-maste Oct 19 22:36:56.123305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-e8d1de99-5d13-4f7a-9f6c-c3653ecb10c2 req-4571161d-f171-41e3-8e35-1650a123c5da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.387879 Oct 19 22:36:56.125188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1974/3955] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:36:56.187375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:56.188453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:56.198432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.212368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.212368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:56.212368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.212368 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.218551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:56.412392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:56.424833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-14952834-7924-457a-8de0-e0f099d7b227 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1613 microversion: 2.1 time: 0.243291 Oct 19 22:36:56.441402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1975/3956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:56 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1613 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:56.554744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-d7a8ef9b-5b41-4ae7-b904-6f011a52cc75 req-78d3def1-f4be-4c48-9b4a-9a9cd1cd83c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1afd0c9-fe0b-4d41-a64e-d8f1e4206920", "name": "network-vif-deleted", "tag": "579c4679-6968-45b0-9575-4b5c79108416"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:36:56.577606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-d7a8ef9b-5b41-4ae7-b904-6f011a52cc75 req-78d3def1-f4be-4c48-9b4a-9a9cd1cd83c3 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.582259 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:56.610572 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-d7a8ef9b-5b41-4ae7-b904-6f011a52cc75 req-78d3def1-f4be-4c48-9b4a-9a9cd1cd83c3 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.616375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-d7a8ef9b-5b41-4ae7-b904-6f011a52cc75 req-78d3def1-f4be-4c48-9b4a-9a9cd1cd83c3 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:56.626658 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:56.628267 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:56.629575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0cc26802-e34e-4595-9045-42aac341e560 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.591305 Oct 19 22:36:56.630349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1982/3957] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:56 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:56.657134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-d7a8ef9b-5b41-4ae7-b904-6f011a52cc75 req-78d3def1-f4be-4c48-9b4a-9a9cd1cd83c3 service nova] Creating event network-vif-deleted:579c4679-6968-45b0-9575-4b5c79108416 for instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 on hv-cinder-maste Oct 19 22:36:56.667505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-d7a8ef9b-5b41-4ae7-b904-6f011a52cc75 req-78d3def1-f4be-4c48-9b4a-9a9cd1cd83c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116617 Oct 19 22:36:56.673690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1976/3958] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:36:56.805031 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:56.805833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:56.817334 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.818828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.821186 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:56.822165 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:56.826717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:56.826717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:57.047293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:57.057701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d1721010-b94f-4b08-adc7-ab4b623af47b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.256947 Oct 19 22:36:57.059633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1983/3959] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:56 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:57.449987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:57.451646 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:57.462722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:57.464917 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:57.468135 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:57.469084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:57.470472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:57.477227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:57.544001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:57.544811 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:57.545644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:57.546253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'fault' on Instance uuid f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:36:57.596094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:57.604576 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-955b6b6d-e07a-4bda-a5bb-78c3dd0759b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1331 microversion: 2.1 time: 0.159864 Oct 19 22:36:57.606243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1977/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:57 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:57.662648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:57.662648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:57.672782 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:57.677276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:57.677276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:57.677276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:57.677276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:57.677646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:58.020433 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:58.039143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:58.041158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:58.042550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-669ef8d0-12a6-426a-9fc0-6104ed150486 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.384555 Oct 19 22:36:58.043739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1984/3961] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:57 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:58.081457 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:58.084631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:58.093042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:58.095321 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:58.096023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:58.096946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:58.097471 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:58.098054 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:58.401129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:58.417031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-236ef07c-cb0c-4f8a-bbdb-f724a705d9ab tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.333279 Oct 19 22:36:58.417031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1978/3962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:58 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:58.639450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:58.640359 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:58.652802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:58.653493 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:58.654085 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:58.655349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:58.657745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:58.658690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:58.698943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:58.700753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:58.701194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:58.701671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'fault' on Instance uuid f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:36:58.752161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:58.764924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d8fc8416-66a1-4a03-93bb-16a476f254c4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 200 len: 1331 microversion: 2.1 time: 0.127509 Oct 19 22:36:58.765699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1985/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:58 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:59.075860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:59.078548 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:59.107448 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:59.110682 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:59.111291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:59.112351 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:59.112985 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:59.113418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:59.309903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:59.320634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:59.322547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:59.324060 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a56a6691-39b0-41b2-b949-55230e4b4ee6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.255806 Oct 19 22:36:59.325633 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1979/3964] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:36:59 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:36:59.438332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:59.438940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:59.447027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:59.450980 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:59.452904 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:59.453829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:59.454287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:59.454894 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:59.622607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:36:59.631653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-965f8ff0-09cd-4ecc-af60-7e20ac10703e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.197726 Oct 19 22:36:59.633347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1986/3965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:59 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:36:59.799984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:59.800648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:36:59.806906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:59.807667 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:59.808658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:59.809463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:36:59.810000 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:36:59.813570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:36:59.828769 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 HTTP/1.1 Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:36:59.830581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:36:59.831812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'f1afd0c9-fe0b-4d41-a64e-d8f1e4206920'} Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:36:59.832666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:36:59.833737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:36:59.835343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:36:59.835343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7cf2a6dc-f5fb-43ac-b9a4-ce15245262b1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 404 len: 111 microversion: 2.1 time: 0.047550 Oct 19 22:36:59.836874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1980/3966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:36:59 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:36:59.842317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5412c78f-d0ab-4ef5-b368-709ff355c9c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '.version_select at 0x7f7332efe160>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:36:59.966900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5412c78f-d0ab-4ef5-b368-709ff355c9c9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-850351834" status: 202 len: 0 microversion: 2.1 time: 0.124650 Oct 19 22:36:59.966900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1987/3967] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Oct 19 22:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-850351834 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:37:00.354980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:00.357763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:00.367602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:00.369405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:00.370096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:00.371722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:00.372468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:00.373541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:00.595366 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:00.604864 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:00.609466 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:00.611785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8897925e-7f42-4437-80d0-4770daf93ae1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.263359 Oct 19 22:37:00.613552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1981/3968] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:00 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:00.660420 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:00.661347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:00.667670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:00.668806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:00.669254 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:00.669956 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:00.670419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:00.670990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:00.827799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:00.836225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-18d11f6d-e672-4ede-ba51-c3fe314bc475 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.180734 Oct 19 22:37:00.839003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1988/3969] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:00 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:01.056467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1511a949-7c06-4fa6-9b2d-1ac437df0177 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: .version_select at 0x7f7332bcf820>, body: {"keypair": {"name": "tempest-keypair-2077667449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRrSCjIx7HQXWb7OVzZsvghsD8IJYrN49z4cW3tn4mTVv7JCxSdbuzP+yAYTzr67yJa4wvC6XoA+R1EeOLne8LgPoBtpiwGB4Pu+uZyPj6ojwjQZkvmNdJu8IMhAk03wQ=="}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:01.073299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-1511a949-7c06-4fa6-9b2d-1ac437df0177 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:37:01.078086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-1511a949-7c06-4fa6-9b2d-1ac437df0177 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'key_pairs'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:37:01.208573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1511a949-7c06-4fa6-9b2d-1ac437df0177 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157685 Oct 19 22:37:01.209671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1982/3970] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Oct 19 22:37:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:37:01.645612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:01.646278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:01.654164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:01.654889 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:01.655566 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:01.656455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:01.657055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:01.657622 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:01.834644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-b065650a-f654-4b25-ac9a-9fa68bbec9c2 req-4a3fbfe0-899b-40e6-a604-7e70b08e8380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd41f7ab-aba7-42df-b4a3-b4c3009c4920", "name": "network-vif-plugged", "status": "completed", "tag": "7a6d435c-73c6-46f6-ba71-be435a81e2dc"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:01.849727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-b065650a-f654-4b25-ac9a-9fa68bbec9c2 req-4a3fbfe0-899b-40e6-a604-7e70b08e8380 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:01.850500 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-b065650a-f654-4b25-ac9a-9fa68bbec9c2 req-4a3fbfe0-899b-40e6-a604-7e70b08e8380 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:01.851205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-b065650a-f654-4b25-ac9a-9fa68bbec9c2 req-4a3fbfe0-899b-40e6-a604-7e70b08e8380 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:01.866625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-b065650a-f654-4b25-ac9a-9fa68bbec9c2 req-4a3fbfe0-899b-40e6-a604-7e70b08e8380 service nova] Creating event network-vif-plugged:7a6d435c-73c6-46f6-ba71-be435a81e2dc for instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 on hv-cinder-maste Oct 19 22:37:01.880995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-b065650a-f654-4b25-ac9a-9fa68bbec9c2 req-4a3fbfe0-899b-40e6-a604-7e70b08e8380 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051078 Oct 19 22:37:01.886468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1983/3971] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:37:01.907138 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:01.908190 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:01.916449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:01.919402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:01.920128 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:01.921384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:01.921997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:01.922832 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:01.955399 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:01.968713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:01.968713 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:01.968968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-35462eba-c0dc-4fc2-a7cb-88f54cdca83e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.329854 Oct 19 22:37:01.970114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1989/3972] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:01 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:02.175679 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:02.186988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa90c8b5-c871-4341-b630-949cb560a28e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.298988 Oct 19 22:37:02.188363 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1984/3973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:01 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:02.996997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:02.997790 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:03.008810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:03.009297 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:03.009738 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:03.010444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:03.010899 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:03.011354 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:03.214983 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:03.216205 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:03.225170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:03.228617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:03.234204 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:03.242844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:03.244335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:03.245259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:03.247454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:03.248217 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:03.248802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:03.255633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f26b21c7-e451-4cbe-9204-6e3975948deb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.262447 Oct 19 22:37:03.259712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1990/3974] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:02 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:03.490026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:03.503170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4c0dafcb-0605-45b9-98c8-153f7583b649 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1265 microversion: 2.1 time: 0.297357 Oct 19 22:37:03.504431 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1985/3975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:03 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:37:04.284551 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:04.285120 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:04.291654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:04.292164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:04.292888 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:04.293604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:04.294214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:04.294638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:04.437236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:04.445352 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:04.446758 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:04.447958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-64562be4-adfa-4d85-bfb9-02230c77eb68 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.167603 Oct 19 22:37:04.448701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1991/3976] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:04 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:04.538710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:04.539276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:04.542783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:04.546167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:04.546659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:04.547207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:04.547903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:04.548390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:04.548816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:04.690183 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:04.698240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ae61dacb-e10a-4843-b231-b70e92ed8c73 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1451 microversion: 2.1 time: 0.163423 Oct 19 22:37:04.698816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1986/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:04 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:04.725847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:04.726450 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:04.732749 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:04.733342 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:04.734122 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:04.734534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:04.735197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:04.735428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:04.783651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2119879719", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a761516-5fa0-488a-a25d-116b70e5b05e"}], "security_groups": [{"name": "tempest-securitygroup--1775512556"}], "key_name": "tempest-keypair-2077667449", "user_data": "}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:04.926023 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] validate_networks() for [('4a761516-5fa0-488a-a25d-116b70e5b05e', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:37:04.949913 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:04.958410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-23530a74-c823-4f15-987b-eeb7d3c756a0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1451 microversion: 2.1 time: 0.236582 Oct 19 22:37:04.959012 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1992/3978] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:04 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1451 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:05.404938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:37:05.406384 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:37:05.406903 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:37:05.407644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:37:05.408243 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:37:05.421558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:05.422374 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:05.422991 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:05.423862 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:05.424467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:05.425029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:05.446332 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:37:05.451420 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Getting quotas for user 57b6c2a1a4a248158c5abbabe61ad634 and project 0a6de28c59e9470aa38566fdc2713ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:37:05.473654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:05.475940 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:05.483487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:37:05.484961 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:05.485716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:05.485827 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:37:05.486698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:05.487707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:05.489162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:05.489831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:05.511142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=100 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:05.613807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c1ad0d29-cf98-4496-8a96-49bf7424a435 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.853268 Oct 19 22:37:05.616132 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1987/3979] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:37:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:37:05.627405 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-335e123c-83ce-4cc3-8685-b2d627f1aa25 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:05.628330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-335e123c-83ce-4cc3-8685-b2d627f1aa25 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:05.754397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:05.769491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:05.772291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:05.774850 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-bfab1027-90ef-4233-b699-5c2a02f229c8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.304957 Oct 19 22:37:05.799930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1993/3980] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:05 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:37:05.845305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-335e123c-83ce-4cc3-8685-b2d627f1aa25 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:05.854349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-335e123c-83ce-4cc3-8685-b2d627f1aa25 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1242 microversion: 2.1 time: 0.231405 Oct 19 22:37:05.856439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1988/3981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:05 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1242 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:37:06.803387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:06.805751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:06.812839 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:06.822434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:06.822903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:06.823673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:06.824160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:06.824601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:06.877102 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:06.877796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:06.886606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:06.887460 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:06.888171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:06.889096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:06.889763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:06.890295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:06.974560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:06.988209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bbe9b23e-bb08-43ca-9c6a-f4a7fee3b672 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1246 microversion: 2.1 time: 0.114788 Oct 19 22:37:06.991673 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1989/3982] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:06 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1246 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:37:07.331620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:07.344718 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:07.349779 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:07.353618 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a44500a6-25b3-449c-bc90-a2d3a96352ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.555925 Oct 19 22:37:07.356667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1994/3983] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:06 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:08.013439 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:08.014066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:08.021590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:08.022086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:08.022523 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:08.023251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:08.025042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:08.025042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:08.123412 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:08.148031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ab8454f2-1c7d-42fa-9f9e-a42fe0304608 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1294 microversion: 2.1 time: 0.136853 Oct 19 22:37:08.148933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1990/3984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:08 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:08.275742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-39827493-56ef-4377-859b-d26ef7192943 req-a5955afd-e41a-4941-9cd8-2271bcfc1552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd41f7ab-aba7-42df-b4a3-b4c3009c4920", "tag": "7a6d435c-73c6-46f6-ba71-be435a81e2dc"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:08.282191 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:08.288052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-39827493-56ef-4377-859b-d26ef7192943 req-a5955afd-e41a-4941-9cd8-2271bcfc1552 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:08.288538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-39827493-56ef-4377-859b-d26ef7192943 req-a5955afd-e41a-4941-9cd8-2271bcfc1552 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:08.288971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-39827493-56ef-4377-859b-d26ef7192943 req-a5955afd-e41a-4941-9cd8-2271bcfc1552 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:08.305162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-39827493-56ef-4377-859b-d26ef7192943 req-a5955afd-e41a-4941-9cd8-2271bcfc1552 service nova] Creating event network-changed:7a6d435c-73c6-46f6-ba71-be435a81e2dc for instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 on hv-cinder-maste Oct 19 22:37:08.310410 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-39827493-56ef-4377-859b-d26ef7192943 req-a5955afd-e41a-4941-9cd8-2271bcfc1552 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039048 Oct 19 22:37:08.311269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1995/3985] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:37:08.386069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:08.386725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:08.404975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:08.407580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:08.409156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:08.410213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:08.411181 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:08.412053 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:08.665025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:08.679396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:08.680848 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:08.682025 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-48d07d2b-b4ba-4795-b634-33b30833111b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.300806 Oct 19 22:37:08.682589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1991/3986] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:08 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:09.175005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:09.175822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:09.182638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:09.183261 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:09.184283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:09.185048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:09.185558 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:09.186048 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:09.285155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:09.293547 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a9a7ff0e-ec57-4108-b023-33b0a5e340b8 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1302 microversion: 2.1 time: 0.122921 Oct 19 22:37:09.294446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1996/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:09 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:09.710697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:09.715483 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:09.728345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:09.728836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:09.729322 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:09.734998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:09.735465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:09.735987 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:10.004298 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:10.019214 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:10.022927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:10.024220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ff2ca1ec-2a38-4734-b114-497f239c7716 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.318487 Oct 19 22:37:10.024802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1992/3988] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:09 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:10.320005 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:10.320898 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:10.329292 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:10.330071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:10.330662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:10.331454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:10.331970 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:10.332391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:10.489389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:10.506176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cad2d1c8-ff5b-4f37-9f30-b8880a039130 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.192499 Oct 19 22:37:10.506752 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1997/3989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:10 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:11.051170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:11.051822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:11.059263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:11.059819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:11.060257 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:11.061083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:11.061534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:11.061953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:11.284666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:11.293274 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:11.294815 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:11.296087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0fa90189-7c21-4fc4-94a7-780e5276a837 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1738 microversion: 2.20 time: 0.249552 Oct 19 22:37:11.296652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1993/3990] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:11 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:11.505829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-df30bf66-4b12-4376-888a-a718efdb2db5 req-b51bf29d-93c3-4050-92f5-f85c2826c0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c", "tag": "adc429b2-7774-4b91-ba7b-31ddca952402"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:11.522539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-df30bf66-4b12-4376-888a-a718efdb2db5 req-b51bf29d-93c3-4050-92f5-f85c2826c0ca service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:11.523906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-df30bf66-4b12-4376-888a-a718efdb2db5 req-b51bf29d-93c3-4050-92f5-f85c2826c0ca service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:11.531402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-df30bf66-4b12-4376-888a-a718efdb2db5 req-b51bf29d-93c3-4050-92f5-f85c2826c0ca service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:11.531545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:11.531545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:11.538712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:11.539229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:11.539665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:11.540365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:11.540809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:11.541231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:11.556608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-df30bf66-4b12-4376-888a-a718efdb2db5 req-b51bf29d-93c3-4050-92f5-f85c2826c0ca service nova] Creating event network-changed:adc429b2-7774-4b91-ba7b-31ddca952402 for instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c on hv-cinder-maste Oct 19 22:37:11.565064 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-df30bf66-4b12-4376-888a-a718efdb2db5 req-b51bf29d-93c3-4050-92f5-f85c2826c0ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063542 Oct 19 22:37:11.566244 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1998/3991] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:37:11.574084 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=100 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:11.777124 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:11.797651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-efca7150-7029-4d84-818d-e359665a9cc0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.271769 Oct 19 22:37:11.798232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1994/3992] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:11 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:37:12.322631 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:12.323465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:12.330060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:12.330550 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:12.331010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:12.331776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:12.332232 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:12.332659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:12.487802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:12.496142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:12.497600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:12.498770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b52abe1e-15b8-4ff0-90a2-72d3df848d85 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1720 microversion: 2.20 time: 0.180825 Oct 19 22:37:12.499357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 1999/3993] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:12 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:12.821391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:12.822071 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:12.829328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:12.829817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:12.830256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:12.830967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:12.831592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:12.832142 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:13.177061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:13.177061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9adacb90-c3ca-4a8f-b1ba-972e416023b9 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.159230 Oct 19 22:37:13.177061 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1995/3994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:12 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:13.524589 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:13.525195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:13.532014 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:13.532498 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:13.532932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:13.533637 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:13.534090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:13.534514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:13.680476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:13.688624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:13.690083 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:13.691255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ccedb7d3-3d15-4d25-a742-355c27f154c3 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1723 microversion: 2.20 time: 0.170704 Oct 19 22:37:13.691808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2000/3995] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:13 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:13.717440 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a92a2f4c-9b4b-4e10-b85d-a61c86301e75"}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:13.719351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-b1c94ce1-6c77-49b0-aac2-9ebc44c007c7 req-4c04139b-7ef5-41e6-9dd6-7be46136ec6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72787a88-c3f6-432e-9ba6-ebfa6ebadb6e", "name": "network-vif-unplugged", "status": "completed", "tag": "228b0721-dbfa-421b-a270-1d3ba83a2f77"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:13.719896 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:13.728344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:13.729624 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:13.731220 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:13.733469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:13.734818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-b1c94ce1-6c77-49b0-aac2-9ebc44c007c7 req-4c04139b-7ef5-41e6-9dd6-7be46136ec6d service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:13.735439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-b1c94ce1-6c77-49b0-aac2-9ebc44c007c7 req-4c04139b-7ef5-41e6-9dd6-7be46136ec6d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:13.736054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-b1c94ce1-6c77-49b0-aac2-9ebc44c007c7 req-4c04139b-7ef5-41e6-9dd6-7be46136ec6d service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:13.747948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:13.748492 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:13.758391 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-b1c94ce1-6c77-49b0-aac2-9ebc44c007c7 req-4c04139b-7ef5-41e6-9dd6-7be46136ec6d service nova] Creating event network-vif-unplugged:228b0721-dbfa-421b-a270-1d3ba83a2f77 for instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e on hv-cinder-maste Oct 19 22:37:13.764654 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-b1c94ce1-6c77-49b0-aac2-9ebc44c007c7 req-4c04139b-7ef5-41e6-9dd6-7be46136ec6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049603 Oct 19 22:37:13.765520 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2001/3996] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:37:14.192492 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:14.193229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:14.199952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:14.200435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:14.200870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:14.201552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:14.202216 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:14.202816 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:14.335911 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:14.343770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-383849db-5ca8-4b13-8e8a-727353d6aa15 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.155533 Oct 19 22:37:14.344335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2002/3997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:14 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:37:15.113797 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7efd7303-e955-4dab-8373-2c955255359d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.401756 Oct 19 22:37:15.114833 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1996/3998] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Oct 19 22:37:13 2022] POST /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-volume_attachments => generated 188 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 22:37:15.250053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:15.250646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:15.257153 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:15.257635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:15.258078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:15.258768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:15.259255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:15.259682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:15.365688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:15.366292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:15.372464 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:15.372948 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:15.373392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:15.374078 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:15.374532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:15.374978 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:15.436403 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:15.507146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:15.514241 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d70d5595-052c-473f-9149-792c67f5a8f3 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.152355 Oct 19 22:37:15.514806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1997/3999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:15 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:37:15.965534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1fa0f1ec-eb71-486a-8968-ce758c38b679 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-volume_attachments/a92a2f4c-9b4b-4e10-b85d-a61c86301e75" status: 202 len: 0 microversion: 2.20 time: 0.719054 Oct 19 22:37:15.966160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2003/4000] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Oct 19 22:37:15 2022] DELETE /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-volume_attachments/a92a2f4c-9b4b-4e10-b85d-a61c86301e75 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:37:16.043665 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:16.044345 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:16.047043 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=12 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:16.051986 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:16.052551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:16.053066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:16.057147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:16.057147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:16.057147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:16.096080 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121021) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 22:37:16.459299 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-56018a20-68d1-48ff-964c-ae2d4c3cd5d5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "POST /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/action" status: 202 len: 0 microversion: 2.20 time: 0.419967 Oct 19 22:37:16.463380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1998/4001] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Oct 19 22:37:16 2022] POST /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:37:16.470995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:16.471604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:16.478720 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:16.479442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:16.483416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:16.483416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:16.483416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:16.483416 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:16.537930 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:16.538527 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:16.545331 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:16.545814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:16.546244 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:16.546995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:16.547450 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:16.551540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:16.654088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:16.663878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:16.665373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:16.666562 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5fc55d4d-1fdd-49a2-ad9f-8b456780a8ac tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1671 microversion: 2.20 time: 0.201539 Oct 19 22:37:16.667390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2004/4002] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:16 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1671 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:37:16.811473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:16.819591 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-91d3bbfa-1ec0-44df-abc4-8d87205d35f6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.285767 Oct 19 22:37:16.820147 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 1999/4003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:16 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:37:17.693203 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:17.693896 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:17.701017 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:17.701511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:17.701978 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:17.702676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:17.703160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:17.703818 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:17.845211 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:17.850872 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:17.862981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:17.863127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:17.863127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:17.863127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a76c465c-4e81-49a8-8b2c-95785cf8a39a tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1671 microversion: 2.20 time: 0.167564 Oct 19 22:37:17.863393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:17.863393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:17.863393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:17.863393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:17.863703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:17.863703 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:17.868142 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2005/4004] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:17 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:17.986723 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-6ed31d5b-057a-49b4-b9b6-7d0d5c57ba7d req-278d8b6e-6075-4eb2-bfc5-3c850c7fee90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c", "name": "network-vif-plugged", "status": "completed", "tag": "adc429b2-7774-4b91-ba7b-31ddca952402"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:17.998555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6ed31d5b-057a-49b4-b9b6-7d0d5c57ba7d req-278d8b6e-6075-4eb2-bfc5-3c850c7fee90 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:17.999125 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6ed31d5b-057a-49b4-b9b6-7d0d5c57ba7d req-278d8b6e-6075-4eb2-bfc5-3c850c7fee90 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:18.010074 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-6ed31d5b-057a-49b4-b9b6-7d0d5c57ba7d req-278d8b6e-6075-4eb2-bfc5-3c850c7fee90 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:18.014271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-6ed31d5b-057a-49b4-b9b6-7d0d5c57ba7d req-278d8b6e-6075-4eb2-bfc5-3c850c7fee90 service nova] Creating event network-vif-plugged:adc429b2-7774-4b91-ba7b-31ddca952402 for instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c on hv-cinder-maste Oct 19 22:37:18.019592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-6ed31d5b-057a-49b4-b9b6-7d0d5c57ba7d req-278d8b6e-6075-4eb2-bfc5-3c850c7fee90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037759 Oct 19 22:37:18.020361 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2006/4005] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:37:18.060288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:18.069085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-954cdf67-9442-4968-bce0-8428ac9bb99a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.222095 Oct 19 22:37:18.070150 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2000/4006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:17 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:18.883647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:18.884429 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:18.891965 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:18.892449 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:18.892881 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:18.893632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:18.894079 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:18.894503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:19.048468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:19.056592 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:19.058039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:19.059825 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e1dc2286-a237-4854-befe-31d4a47a30ab tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1673 microversion: 2.20 time: 0.180981 Oct 19 22:37:19.060389 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2007/4007] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:18 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:19.093009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:19.093608 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:19.101308 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:19.101825 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:19.103178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:19.105979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:19.105979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:19.105979 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:19.268468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:19.273860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-58611338-5301-4a9a-b130-b5cbb787d6a4 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1368 microversion: 2.1 time: 0.185076 Oct 19 22:37:19.274611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2001/4008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:19 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:20.085722 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:20.086327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:20.093323 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:20.094073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:20.094568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:20.095385 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:20.095734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:20.096162 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:20.252939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:20.262101 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:20.263590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:20.264778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-894ed7e6-6f99-4274-b027-c3eb3a312f39 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.183088 Oct 19 22:37:20.265644 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2008/4009] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:20 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:20.297543 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:20.298218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:20.305044 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:20.305768 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:20.306844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:20.307596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:20.308185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:20.308491 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:20.440224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:20.448226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-78a25977-7524-4f0c-a130-25635b8ec83b tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1559 microversion: 2.1 time: 0.155221 Oct 19 22:37:20.448785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2002/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:20 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:20.471388 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:20.471870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:20.477762 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:20.478226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:20.478656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:20.479350 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:20.479796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:20.480215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:20.556852 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e23abc9e-c32a-4868-a31d-d04c0d3f2725 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089227 Oct 19 22:37:20.557451 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2009/4011] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Oct 19 22:37:20 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:37:21.289790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:21.290396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:21.296806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:21.297315 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:21.297777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:21.298489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:21.298937 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:21.299390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:21.473813 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:21.482370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:21.483842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:21.485009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8034f784-94d4-412d-98af-a35c34ed0ca5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.199326 Oct 19 22:37:21.485921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2003/4012] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:21 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:21.527372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-e35dc1fd-7e88-4626-9f51-e8140b3f1339 req-722e9c74-c6b0-4f4b-b3ec-ce729dd5a301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c", "tag": "adc429b2-7774-4b91-ba7b-31ddca952402"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:21.536575 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-e35dc1fd-7e88-4626-9f51-e8140b3f1339 req-722e9c74-c6b0-4f4b-b3ec-ce729dd5a301 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:21.537057 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-e35dc1fd-7e88-4626-9f51-e8140b3f1339 req-722e9c74-c6b0-4f4b-b3ec-ce729dd5a301 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:21.537489 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-e35dc1fd-7e88-4626-9f51-e8140b3f1339 req-722e9c74-c6b0-4f4b-b3ec-ce729dd5a301 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:21.548890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-e35dc1fd-7e88-4626-9f51-e8140b3f1339 req-722e9c74-c6b0-4f4b-b3ec-ce729dd5a301 service nova] Creating event network-changed:adc429b2-7774-4b91-ba7b-31ddca952402 for instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c on hv-cinder-maste Oct 19 22:37:21.553879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-e35dc1fd-7e88-4626-9f51-e8140b3f1339 req-722e9c74-c6b0-4f4b-b3ec-ce729dd5a301 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030629 Oct 19 22:37:21.554469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2010/4013] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:37:22.510685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:22.511260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:22.518637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:22.519171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:22.519648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:22.520344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:22.520798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:22.521224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:22.648555 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:22.656641 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:22.658079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:22.659269 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3558e59e-6348-4671-b4fd-41042a393f06 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.152709 Oct 19 22:37:22.659822 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2004/4014] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:22 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:23.686262 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:23.687164 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:23.693795 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:23.694304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:23.694745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:23.695496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:23.696071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:23.696500 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:23.714572 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:23.993131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:24.005071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:24.005071 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:24.005635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8af09c92-6fde-460a-b9fe-86a607811951 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.324541 Oct 19 22:37:24.017552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2011/4015] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:23 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:25.033477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:25.034085 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:25.043746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:25.044564 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:25.045218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:25.046162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:25.046844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:25.047501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:25.213323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:25.233260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:25.234867 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:25.236965 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f6d6730b-07f3-4507-bc74-79499f06024b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.208982 Oct 19 22:37:25.237683 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2005/4016] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:25 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:26.261802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:26.263070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:26.270453 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:26.270946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:26.271407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:26.272110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:26.272565 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:26.275081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:26.425848 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:26.434264 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:26.435778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:26.436954 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-22fbfdf5-c51f-4dba-87a3-5f6eeb031a78 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.179142 Oct 19 22:37:26.437514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2012/4017] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:26 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:27.464176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:27.464790 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:27.471946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:27.472434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:27.472904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:27.473615 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:27.474070 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:27.474494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:27.623337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:27.639398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:27.641295 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:27.642487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dbafbf44-e46e-4622-9bfe-4ff3fee547f8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.183505 Oct 19 22:37:27.643233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2006/4018] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:27 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:28.668107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:28.668724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:28.675351 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:28.675836 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:28.676273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:28.676968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:28.677418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:28.678018 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:28.823470 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:28.832731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:28.834197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:28.835383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dd2b1fee-4449-42d5-b353-313341056c14 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.171144 Oct 19 22:37:28.836016 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2013/4019] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:28 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:29.861634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:29.862382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:29.869984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:29.871994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:29.871994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:29.872652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:29.873184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:29.873625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:29.896253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:30.023089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:30.033380 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:30.035177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:30.036541 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0e5aa46c-1292-4d7b-9893-35980efb186b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.179249 Oct 19 22:37:30.042007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2007/4020] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:29 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:31.061828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:31.062393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:31.069095 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:31.070665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:31.070665 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:31.070867 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:31.071218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:31.071648 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:31.240114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:31.248827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:31.250563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:31.251785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-52bc7a54-4630-4030-a078-a7db88406455 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.194015 Oct 19 22:37:31.252619 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2014/4021] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:31 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:32.285225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:32.286472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:32.293534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:32.294228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:32.294672 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:32.295393 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:32.295843 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:32.296260 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:32.435250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:32.443442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:32.444913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:32.446064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ac68ddb4-7e1d-4fc8-ae4f-3bc8dc01b6e7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.165822 Oct 19 22:37:32.446623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2008/4022] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:32 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:33.472322 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:33.472943 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:33.479326 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:33.479808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:33.480272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:33.480959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:33.481414 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:33.481842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:33.608643 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:33.616703 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:33.618134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:33.619430 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ab4376c7-1669-4ed8-8133-e35ff2a55cf1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.151098 Oct 19 22:37:33.620020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2015/4023] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:33 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:34.644988 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:34.645594 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:34.652015 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:34.653199 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:34.653423 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:34.654104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:34.654557 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:34.655011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:34.784494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:34.793159 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:34.794612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:34.795805 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-28db8fb3-c2a3-48fa-aba1-109d9f02c34d tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.154736 Oct 19 22:37:34.797152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2009/4024] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:34 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:35.826780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:35.827403 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:35.833742 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:35.834217 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:35.834647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:35.835376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:35.835823 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:35.836246 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:35.965677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:35.973997 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:35.975475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:35.976639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e1732e82-41cb-4bc5-bd98-93256cc50056 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.153822 Oct 19 22:37:35.982052 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2016/4025] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:35 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:37.003201 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:37.003809 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:37.006503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:37.010842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:37.011360 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:37.011826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:37.012517 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:37.012971 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:37.013396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:37.142272 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:37.150343 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:37.151826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:37.153014 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-696f332b-881e-43af-b495-8afec1418754 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.153811 Oct 19 22:37:37.153580 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2010/4026] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:36 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:38.177677 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:38.178282 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:38.185287 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:38.190702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:38.190702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:38.190702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:38.190702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:38.191059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:38.328001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:38.336378 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:38.351664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:38.351664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4a960e4e-2d5b-4437-87e6-ebcb87d005ef tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.165329 Oct 19 22:37:38.351664 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2017/4027] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:38 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 22:37:39.365211 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:39.365816 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:39.371786 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:39.372262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:39.372691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:39.373367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:39.373814 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:39.374231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:39.510197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:39.519001 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:39.520442 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:39.521592 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a06fe623-6b1a-4e33-8958-108d3d70e0ee tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.160538 Oct 19 22:37:39.522139 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2011/4028] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:39 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:39.897693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-55833ca4-9d91-47ef-b5a4-d0edab34a94f req-b77c1fb9-0f93-42b7-b5e0-2d7a439bcea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72787a88-c3f6-432e-9ba6-ebfa6ebadb6e", "name": "network-vif-plugged", "status": "completed", "tag": "228b0721-dbfa-421b-a270-1d3ba83a2f77"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:39.907345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-55833ca4-9d91-47ef-b5a4-d0edab34a94f req-b77c1fb9-0f93-42b7-b5e0-2d7a439bcea2 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:39.907827 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-55833ca4-9d91-47ef-b5a4-d0edab34a94f req-b77c1fb9-0f93-42b7-b5e0-2d7a439bcea2 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:39.908263 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-55833ca4-9d91-47ef-b5a4-d0edab34a94f req-b77c1fb9-0f93-42b7-b5e0-2d7a439bcea2 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:39.919126 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-55833ca4-9d91-47ef-b5a4-d0edab34a94f req-b77c1fb9-0f93-42b7-b5e0-2d7a439bcea2 service nova] Creating event network-vif-plugged:228b0721-dbfa-421b-a270-1d3ba83a2f77 for instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e on hv-cinder-maste Oct 19 22:37:39.924519 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-55833ca4-9d91-47ef-b5a4-d0edab34a94f req-b77c1fb9-0f93-42b7-b5e0-2d7a439bcea2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Oct 19 22:37:39.925462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2018/4029] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:37:40.547929 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:40.550449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:40.555202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:40.555687 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:40.556148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:40.556836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:40.557289 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:40.557714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:40.708630 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:40.717718 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:40.719180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:40.720325 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a809029e-68f5-4733-b603-8d3a2d05c075 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.177325 Oct 19 22:37:40.720883 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2012/4030] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:40 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:41.748817 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:41.749508 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:41.753132 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=48 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:41.756653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:41.757150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:41.757582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:41.758265 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:41.758711 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:41.759195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:41.898686 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:41.907638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:41.909075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:41.910236 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d3d67d28-6143-44fa-881f-a3f6a3707642 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.166718 Oct 19 22:37:41.910788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2019/4031] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:41 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:42.936674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:42.937189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:42.943636 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:42.944113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:42.944552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:42.945288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:42.945741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:42.946189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:43.083568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:43.092075 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:43.093498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:43.094655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-06a9afb4-4c7b-4be1-8a26-9770f70991ea tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.162665 Oct 19 22:37:43.095240 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2013/4032] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:42 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:44.122226 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:44.122739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:44.129238 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:44.129716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:44.130150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:44.130833 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:44.131316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:44.131767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:44.265485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:44.275036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:44.276456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:44.277788 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-eb56003f-735c-405d-8ce7-39c3777d34a6 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.160151 Oct 19 22:37:44.278357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2020/4033] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:44 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:45.304648 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:45.305171 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:45.312534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:45.312950 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:45.313389 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:45.314081 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:45.314537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:45.314975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:45.446444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:45.454418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:45.455873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:45.457033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-437ed9f3-74b3-4d88-b1a7-f44b2fc430cb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.156339 Oct 19 22:37:45.457587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2014/4034] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:45 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:46.482638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:46.483272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:46.489699 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:46.490176 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:46.493895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:46.493895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:46.493895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:46.493895 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:46.626280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:46.634483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:46.635999 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:46.637778 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-433088ee-485a-4604-abd0-8577780d8efe tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1729 microversion: 2.20 time: 0.158395 Oct 19 22:37:46.638328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2021/4035] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:46 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:47.665480 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:47.666038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:47.672994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:47.673482 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:47.673916 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:47.674602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:47.675119 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:47.675540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:47.806942 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:47.815452 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:47.816898 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:47.818059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-38d12d27-c946-4f29-89ef-8d03d8918c8e tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1716 microversion: 2.20 time: 0.156683 Oct 19 22:37:47.818617 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2015/4036] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:37:47 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:37:57.393802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-820649218", "imageRef": "87ec5e1e-d3ce-4b0d-aebb-c26314376f20", "flavorRef": "452"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:37:57.401241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=5 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:57.401925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=59 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:57.446753 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] validate_networks() for None {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:37:57.713407 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:37:57.713828 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:37:57.714554 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:37:57.715024 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:37:57.715436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:37:57.724732 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:57.725209 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:57.725642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:57.726363 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:57.726815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:57.727269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:57.743468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Getting quotas for project 6e4ff5b1b2104c2b8432c3bd7e749e5a. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:37:57.747368 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Getting quotas for user bb5498b4fb7e4b54ae07bb7659a46ecd and project 6e4ff5b1b2104c2b8432c3bd7e749e5a. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:37:57.757963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:37:57.760245 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87ec5e1e-d3ce-4b0d-aebb-c26314376f20',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:37:57.872992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f47859de-354c-4d5b-9fe4-00b3819744d3 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482968 Oct 19 22:37:57.873641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2022/4037] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:37:57.884637 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-762983e8-9fcf-4eb0-9d99-d050aa203135 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:57.885255 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-762983e8-9fcf-4eb0-9d99-d050aa203135 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:57.887737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=11 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:57.888402 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=50 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:37:57.940432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-762983e8-9fcf-4eb0-9d99-d050aa203135 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:57.947831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-762983e8-9fcf-4eb0-9d99-d050aa203135 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1214 microversion: 2.1 time: 0.067066 Oct 19 22:37:57.948397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2016/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:57 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:37:58.971869 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:37:58.972596 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:37:58.979098 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:58.979676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:58.980041 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:58.980725 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:37:58.981175 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:37:58.981601 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:37:59.042642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:37:59.050271 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-6770f641-c0ab-48c7-b38d-2e2befc496c6 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1218 microversion: 2.1 time: 0.083355 Oct 19 22:37:59.050831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2023/4039] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:37:58 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:00.073956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:00.074859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:00.082320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:00.082803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:00.083267 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:00.084180 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:00.084622 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:00.085100 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:00.150396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:00.159938 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-654d2a30-96d1-4c71-a67a-7e05ecb7ab4e tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1274 microversion: 2.1 time: 0.091014 Oct 19 22:38:00.160699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2017/4040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:00 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:01.184003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:01.184728 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:01.191755 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:01.192401 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:01.193078 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:01.193857 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:01.194537 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:01.195072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:01.414862 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:01.432173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2a215be2-b63b-442a-b865-4e14a72e8ef7 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.252353 Oct 19 22:38:01.432743 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2024/4041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:01 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:02.037911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-0e261e39-e925-4df5-b314-40e9cd5f3b0e req-e52914fa-984f-4adc-b30d-fe5a089c2387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7374a6be-fb6a-4695-a394-5ee5dd276ff0", "tag": "7dd18bea-d776-4b4c-83d3-3a5c937e8848"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:38:02.048302 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-0e261e39-e925-4df5-b314-40e9cd5f3b0e req-e52914fa-984f-4adc-b30d-fe5a089c2387 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:02.051097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-0e261e39-e925-4df5-b314-40e9cd5f3b0e req-e52914fa-984f-4adc-b30d-fe5a089c2387 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:02.051097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-0e261e39-e925-4df5-b314-40e9cd5f3b0e req-e52914fa-984f-4adc-b30d-fe5a089c2387 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:02.060165 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-0e261e39-e925-4df5-b314-40e9cd5f3b0e req-e52914fa-984f-4adc-b30d-fe5a089c2387 service nova] Creating event network-changed:7dd18bea-d776-4b4c-83d3-3a5c937e8848 for instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 on hv-cinder-maste Oct 19 22:38:02.065967 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-0e261e39-e925-4df5-b314-40e9cd5f3b0e req-e52914fa-984f-4adc-b30d-fe5a089c2387 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031878 Oct 19 22:38:02.067010 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2018/4042] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:38:02.455348 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:02.455967 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:02.462625 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:02.463161 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:02.463612 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:02.464641 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:02.465258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:02.465849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:02.667698 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:02.681501 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-dcef73d4-08db-4d76-a0f3-3bac29b70613 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.230353 Oct 19 22:38:02.682258 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2025/4043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:02 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:03.705936 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:03.706656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:03.712792 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:03.713279 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:03.713714 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:03.714671 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:03.715158 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:03.715581 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:03.849997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:03.858037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-f45f0f1a-2f2a-4680-8d08-21ad66b9ce66 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.157258 Oct 19 22:38:03.863766 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2019/4044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:03 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:04.880834 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:04.881442 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:04.887841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:04.888324 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:04.888757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:04.889446 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:04.889903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:04.890371 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:05.027856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:05.036316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-4f57d4fd-c45d-4ca9-8ed7-ae440ae5ddc0 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.159326 Oct 19 22:38:05.037757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2026/4045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:04 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:06.058397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:06.059074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:06.066219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:06.066706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:06.067200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:06.067932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:06.068388 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:06.068859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:06.219226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:06.227463 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-fa216469-3a96-45d2-a772-d1b8dd87a5f8 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.173339 Oct 19 22:38:06.228056 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2020/4046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:06 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:07.251577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:07.252189 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:07.258507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:07.259015 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:07.259461 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:07.260127 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:07.260577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:07.260992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:07.391235 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:07.398847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1e57a8e5-6c80-4d6a-95b3-8f505d1623ea tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.151705 Oct 19 22:38:07.399439 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2027/4047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:07 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:08.102578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-94130c95-9ad0-4de7-b593-e934ffc0f361 req-caaccd90-516e-447c-b9b9-a06bfe8bb666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7374a6be-fb6a-4695-a394-5ee5dd276ff0", "name": "network-vif-plugged", "status": "completed", "tag": "7dd18bea-d776-4b4c-83d3-3a5c937e8848"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:38:08.108031 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:38:08.113140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-94130c95-9ad0-4de7-b593-e934ffc0f361 req-caaccd90-516e-447c-b9b9-a06bfe8bb666 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:08.113875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-94130c95-9ad0-4de7-b593-e934ffc0f361 req-caaccd90-516e-447c-b9b9-a06bfe8bb666 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:08.114035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-94130c95-9ad0-4de7-b593-e934ffc0f361 req-caaccd90-516e-447c-b9b9-a06bfe8bb666 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:08.124573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-94130c95-9ad0-4de7-b593-e934ffc0f361 req-caaccd90-516e-447c-b9b9-a06bfe8bb666 service nova] Creating event network-vif-plugged:7dd18bea-d776-4b4c-83d3-3a5c937e8848 for instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 on hv-cinder-maste Oct 19 22:38:08.129713 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-94130c95-9ad0-4de7-b593-e934ffc0f361 req-caaccd90-516e-447c-b9b9-a06bfe8bb666 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030932 Oct 19 22:38:08.130381 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2021/4048] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:08.421148 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:08.421673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:08.423538 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:38:08.424212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=6 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:38:08.429503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:08.430023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:08.430462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:08.431181 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:08.431635 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:08.434672 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:08.570621 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:08.578885 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-05c8b4c2-57fc-46dc-9b0d-e8360b764172 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.161815 Oct 19 22:38:08.579600 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2028/4049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:08 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:09.602681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:09.603473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:09.610562 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:09.611074 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:09.611511 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:09.612197 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:09.612653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:09.613076 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:09.742462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:09.750612 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-991d6ee2-0993-4bc7-9709-590c8e3a22fd tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1314 microversion: 2.1 time: 0.152637 Oct 19 22:38:09.755087 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2022/4050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:09 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:10.772632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:10.773168 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:10.779060 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:10.779539 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:10.779971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:10.780642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:10.781088 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:10.781504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:10.906649 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:10.914240 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed19ba07-5bcf-42a8-8806-47cca0260e03 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1464 microversion: 2.1 time: 0.145722 Oct 19 22:38:10.914806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2029/4051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:10 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:10.964507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:10.965007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:10.971286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:10.971764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:10.972196 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:10.972870 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:10.973316 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:10.973759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:10.998333 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:38:11.324375 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-0e9a9e50-ab8a-4ae7-85cf-c7b3afe6aa60 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 204 len: 0 microversion: 2.1 time: 0.363691 Oct 19 22:38:11.324962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2023/4052] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:38:10 2022] DELETE /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:38:11.333037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:11.333646 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:11.340081 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:11.340563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:11.341006 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:11.341691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:11.342141 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:11.342586 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:11.473040 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:11.480604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c976b60f-8438-4145-a8dd-c6e656f882cf tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1470 microversion: 2.1 time: 0.151440 Oct 19 22:38:11.481160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2030/4053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:11 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:12.505141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:12.505845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:12.512282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:12.512761 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:12.513200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:12.513881 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:12.515077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:12.515510 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:12.643865 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:12.651387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9fa08bcb-b230-4f00-bf35-a5839b76388a tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1470 microversion: 2.1 time: 0.150517 Oct 19 22:38:12.651946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2024/4054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:12 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:13.535875 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-3cebe170-d73e-42a5-82af-e4d06fde791c req-9750602b-3b33-4b23-a9f3-b89ddf7fcb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7374a6be-fb6a-4695-a394-5ee5dd276ff0", "name": "network-vif-deleted", "tag": "7dd18bea-d776-4b4c-83d3-3a5c937e8848"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:38:13.546933 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3cebe170-d73e-42a5-82af-e4d06fde791c req-9750602b-3b33-4b23-a9f3-b89ddf7fcb90 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:13.547456 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3cebe170-d73e-42a5-82af-e4d06fde791c req-9750602b-3b33-4b23-a9f3-b89ddf7fcb90 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:13.547883 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-3cebe170-d73e-42a5-82af-e4d06fde791c req-9750602b-3b33-4b23-a9f3-b89ddf7fcb90 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:13.559647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-3cebe170-d73e-42a5-82af-e4d06fde791c req-9750602b-3b33-4b23-a9f3-b89ddf7fcb90 service nova] Creating event network-vif-deleted:7dd18bea-d776-4b4c-83d3-3a5c937e8848 for instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 on hv-cinder-maste Oct 19 22:38:13.565776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-3cebe170-d73e-42a5-82af-e4d06fde791c req-9750602b-3b33-4b23-a9f3-b89ddf7fcb90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Oct 19 22:38:13.566787 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2031/4055] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:13.674371 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:13.675029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:13.681640 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:13.682083 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:13.687188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:13.687188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:13.687188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:13.687188 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:13.745963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5498b4fb7e4b54ae07bb7659a46ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4ff5b1b2104c2b8432c3bd7e749e5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:13.754066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e9f4e47b-4301-4aef-88d8-fd7386da6992 tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 200 len: 1299 microversion: 2.1 time: 0.084187 Oct 19 22:38:13.754604 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2025/4056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:13 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:14.777247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:14.777960 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] [instance: 7374a6be-fb6a-4695-a394-5ee5dd276ff0] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:14.784636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:14.785136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:14.785574 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:14.786272 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:14.786731 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:14.787194 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:14.800987 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] HTTP exception thrown: Instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 could not be found. Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Request method failure captured: Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 HTTP/1.1 Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHxDSZvJvEGntHB5Ax3JYagJZKmKp1wsd2psp3VMRQUphOK-DsyRAZOZUDWp6fjJeweiTO02N5qVM6nBAH8NpVG_-opXFE7cHX5TAP40K92fxfWvPDl2imeorNVSPtuW5okFYwMvxscDnbLbHMl2Tn5YDmrFFIHEQ4wxIyb5tVM12uc Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 6e4ff5b1b2104c2b8432c3bd7e749e5a Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-VolumesNegativeTest-1274042981 Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:38:14.802633 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e4ff5b1b2104c2b8432c3bd7e749e5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e4ff5b1b2104c2b8432c3bd7e749e5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e4ff5b1b2104c2b8432c3bd7e749e5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e4ff5b1b2104c2b8432c3bd7e749e5a"}]}] Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-VolumesNegativeTest-1274042981 Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 6e4ff5b1b2104c2b8432c3bd7e749e5a Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-VolumesNegativeTest-1274042981 Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-VolumesNegativeTest-1274042981-project Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: bb5498b4fb7e4b54ae07bb7659a46ecd Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-VolumesNegativeTest-1274042981-project Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 could not be found. Oct 19 22:38:14.804155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '7374a6be-fb6a-4695-a394-5ee5dd276ff0'} Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 could not be found. Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:14.804963 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 could not be found. Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 could not be found. Oct 19 22:38:14.806257 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:14.807763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] Returning 404 to user: Instance 7374a6be-fb6a-4695-a394-5ee5dd276ff0 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:14.807763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5178b39b-0ea7-4775-91f6-dd5bbdb4ea5f tempest-VolumesNegativeTest-1274042981 tempest-VolumesNegativeTest-1274042981-project] 10.222.0.20 "GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0" status: 404 len: 111 microversion: 2.1 time: 0.031076 Oct 19 22:38:14.807763 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2032/4057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:14 2022] GET /compute/v2.1/servers/7374a6be-fb6a-4695-a394-5ee5dd276ff0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:16.710904 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:16.711432 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:16.719373 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:16.719855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:16.720291 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:16.720982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:16.721477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:16.721906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:16.752798 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a091d677-944f-4a10-9ece-3d085fb3eb55 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/ips" status: 200 len: 151 microversion: 2.1 time: 0.045746 Oct 19 22:38:16.753313 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2026/4058] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Oct 19 22:38:16 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:18.385289 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59308b5d-2605-46f7-8377-6a9a35014e49"}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:38:18.387636 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:18.394499 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:18.394992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:18.395421 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:18.396097 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:18.396541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:18.396958 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:19.150608 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c25464ef-2f12-4e0b-9475-1f92a27c3333 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "POST /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768986 Oct 19 22:38:19.151255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2033/4059] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Oct 19 22:38:18 2022] POST /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:27.925690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:27.927894 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:27.930497 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:38:27.931167 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:38:27.936268 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:27.936741 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:27.937198 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:27.937875 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:27.938323 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:27.938739 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:27.968140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-9134d217-43e8-4911-be08-00106f505b0f tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046247 Oct 19 22:38:27.968874 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2027/4060] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Oct 19 22:38:27 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:28.035780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:28.039338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:28.039338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:38:28.043206 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:28.043693 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:28.044138 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:28.044830 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:28.045288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:28.045715 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:28.049706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:38:28.071611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Going to try to terminate instance {{(pid=121022) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:38:28.340719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-398e8b14-99a1-4ff1-924e-715bc69de4c7 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 204 len: 0 microversion: 2.20 time: 0.309478 Oct 19 22:38:28.341304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2034/4061] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 19 22:38:28 2022] DELETE /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 22:38:28.349570 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:28.350177 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:28.357509 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:28.357992 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:28.358429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:28.359662 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:28.360115 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:28.360674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:28.492526 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:28.501588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:28.503048 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:28.504209 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-17090d44-7a48-4bb2-8958-210894679a50 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.158527 Oct 19 22:38:28.504755 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2028/4062] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:28 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:29.531392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:29.532084 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:29.539819 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:29.540300 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:29.540734 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:29.541413 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:29.541865 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:29.542316 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:29.670667 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:29.679934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:29.681483 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:29.682661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-902ce0c3-4783-491d-80dd-95f8e549bebf tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.156236 Oct 19 22:38:29.683333 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2035/4063] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:29 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:30.708552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:30.709149 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:30.716281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:30.716756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:30.717184 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:30.717857 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:30.718300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:30.718715 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:30.848066 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:30.862806 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:30.864276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:30.865426 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-afc02150-3182-4c0d-bba5-c127fae77ceb tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.161422 Oct 19 22:38:30.865980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2029/4064] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:30 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:31.891934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:31.892534 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:31.899042 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:31.899524 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:31.899984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:31.900670 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:31.901484 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:31.901891 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:32.029751 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:32.037959 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:32.039463 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:32.040556 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3df0c137-6e14-488c-bf5f-7b074764f733 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.153313 Oct 19 22:38:32.041110 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2036/4065] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:31 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:33.065793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:33.067097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:33.074208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:33.074995 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:33.076095 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:33.077802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:33.078456 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:33.079364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:33.150135 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:33.155518 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:33.158890 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:33.159438 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:33.159878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:33.160582 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:33.161080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:33.161750 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:33.218764 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:33.227590 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:33.230179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:33.230485 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-4d28f0c0-04b2-4e33-99c1-ac0190f02130 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1722 microversion: 2.20 time: 0.168502 Oct 19 22:38:33.231573 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2030/4066] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:33 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:33.263754 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'services' on Instance uuid 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:38:33.494274 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-a8491d92-43b4-472e-b5c8-84385aa20f16 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments/59308b5d-2605-46f7-8377-6a9a35014e49" status: 202 len: 0 microversion: 2.1 time: 0.348817 Oct 19 22:38:33.496623 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2037/4067] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Oct 19 22:38:33 2022] DELETE /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments/59308b5d-2605-46f7-8377-6a9a35014e49 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:38:33.504232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:33.506390 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:33.512486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:33.512975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:33.516202 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:33.517222 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:33.517691 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:33.518344 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:33.548628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-cb66c618-afe0-4135-9fb9-1708c3ec2135 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049233 Oct 19 22:38:33.549189 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2031/4068] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:38:33 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:33.717028 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-1c2bec5f-3d14-4733-8e25-ffb469ca7529 req-bad5bd9f-8ed4-4dd6-b635-d18507ed9c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72787a88-c3f6-432e-9ba6-ebfa6ebadb6e", "name": "network-vif-deleted", "tag": "228b0721-dbfa-421b-a270-1d3ba83a2f77"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:38:33.726691 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1c2bec5f-3d14-4733-8e25-ffb469ca7529 req-bad5bd9f-8ed4-4dd6-b635-d18507ed9c01 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:33.727198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1c2bec5f-3d14-4733-8e25-ffb469ca7529 req-bad5bd9f-8ed4-4dd6-b635-d18507ed9c01 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:33.727632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-1c2bec5f-3d14-4733-8e25-ffb469ca7529 req-bad5bd9f-8ed4-4dd6-b635-d18507ed9c01 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:33.738879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-1c2bec5f-3d14-4733-8e25-ffb469ca7529 req-bad5bd9f-8ed4-4dd6-b635-d18507ed9c01 service nova] Creating event network-vif-deleted:228b0721-dbfa-421b-a270-1d3ba83a2f77 for instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e on hv-cinder-maste Oct 19 22:38:33.743712 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-1c2bec5f-3d14-4733-8e25-ffb469ca7529 req-bad5bd9f-8ed4-4dd6-b635-d18507ed9c01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Oct 19 22:38:33.744298 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2038/4069] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:34.256004 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:34.256747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:34.263919 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:34.264532 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:34.265597 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:34.266361 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:34.266891 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:34.267407 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:34.333445 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:34.345498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:34.345498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:34.345804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-3da01556-71c9-42b4-ad33-35c35a42be52 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1655 microversion: 2.20 time: 0.093748 Oct 19 22:38:34.346275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2032/4070] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:34 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1655 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:34.562394 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:34.564676 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:34.570653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:34.571160 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:34.571593 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:34.572269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:34.572714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:34.573131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:34.604301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-5e2129f4-e7b3-4249-b0da-b82245c24bd1 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Oct 19 22:38:34.604866 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2039/4071] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:38:34 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:35.369981 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:35.370589 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:35.377654 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:35.378137 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:35.378578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:35.379300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:35.379756 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:35.380182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:35.440166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:35.448174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:35.449611 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:35.450759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a70146e4-267b-4420-b579-ab45e89299d8 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1655 microversion: 2.20 time: 0.084733 Oct 19 22:38:35.451342 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2033/4072] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:35 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:35.616652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:35.618829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:35.625219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:35.625642 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:35.626073 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:35.626747 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:35.627230 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:35.627671 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:35.656375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ed4d1bd8-ea64-4adc-a4a5-a98eb4dbcac2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043623 Oct 19 22:38:35.656912 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2040/4073] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:38:35 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:36.476777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:36.477365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:36.484229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:36.484708 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:36.485156 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:36.485831 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:36.486292 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:36.486722 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:36.548219 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:36.556178 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:36.557602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:36.558738 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-a36f95fa-7629-4b40-b1d9-c19465bda948 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1655 microversion: 2.20 time: 0.085861 Oct 19 22:38:36.559317 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2034/4074] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:36 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1655 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:36.669374 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:36.672278 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:36.678996 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:36.679491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:36.679930 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:36.680620 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:36.681075 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:36.681502 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:36.715673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7533e675-3a98-46c7-863a-926f407ba1c6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050842 Oct 19 22:38:36.716233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2041/4075] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:38:36 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:37.584153 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:37.586107 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:37.591047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:37.591538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:37.591973 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:37.593249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:37.593711 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:37.594130 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:37.630539 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:37.631073 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:37.631487 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:37.631927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.objects.instance [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lazy-loading 'fault' on Instance uuid 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e {{(pid=121021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:38:37.681079 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:37.690486 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:37.691964 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9b4be7642f3441ab83cf81e1029e017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88309b84283a4052aa1d957047390cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:37.693134 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-90a92542-130f-4690-9b47-12ce990f769b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 200 len: 1370 microversion: 2.20 time: 0.113065 Oct 19 22:38:37.693685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2035/4076] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:37 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 22:38:37.730241 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:37.732402 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:37.739055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:37.739542 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:37.739975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:37.741936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:37.741936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:37.741936 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:37.774915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8a2e4755-70c5-487f-9240-7f7e96ab65c0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048663 Oct 19 22:38:37.775486 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2042/4077] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Oct 19 22:38:37 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 22:38:37.842844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:37.843644 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:37.849751 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:37.850231 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:37.850663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:37.851416 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:37.851866 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:37.852285 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:37.879796 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:38:38.201639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-01a0abaa-5e33-4c3d-81ea-d9743627d693 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 204 len: 0 microversion: 2.1 time: 0.362575 Oct 19 22:38:38.202369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2036/4078] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:38:37 2022] DELETE /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:38:38.210383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:38.211106 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:38.218054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:38.218054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:38.218471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:38.219227 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:38.219684 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:38.220137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:38.351916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:38.360269 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-f70f1fd9-d028-446a-a23d-97ca11289c83 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1684 microversion: 2.1 time: 0.153702 Oct 19 22:38:38.369397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2043/4079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:38 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:38.720041 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:38.720734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:38.727113 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:38.727596 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:38.728029 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:38.728779 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:38.729227 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:38.729656 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:38.745097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] HTTP exception thrown: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Request method failure captured: Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e HTTP/1.1 Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPjOrSHuHfDjRUlCmdI-NxfHuDXv3db4iBtYmigoHV-4qZnkDKAaSNfciMNMllsNUvcsbAqpwaO8rvl3ciMUOGuLvE8VKiDCx7GGvGHcSDXN1QDWBU3TikYRraiaQFoIlBnAAsPweESDw_3se6thJsEDoygEYa-uuNlFBIC5eRBF_M Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:38.746705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88309b84283a4052aa1d957047390cb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88309b84283a4052aa1d957047390cb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}] Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: f9b4be7642f3441ab83cf81e1029e017 Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:38.748346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '72787a88-c3f6-432e-9ba6-ebfa6ebadb6e'} Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:38.749414 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:38.750846 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:38.752112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Returning 404 to user: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:38.752112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-89074e2c-702c-4619-b3a5-55077f98d87c tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 404 len: 111 microversion: 2.20 time: 0.033004 Oct 19 22:38:38.752112 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2037/4080] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:38 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:38:38.757010 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d1a168fd-90d2-4648-88c0-7aaee2067584 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '.version_select at 0x7f733304edc0>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:38.832714 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d1a168fd-90d2-4648-88c0-7aaee2067584 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344050180" status: 204 len: 0 microversion: 2.20 time: 0.079576 Oct 19 22:38:38.833341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2044/4081] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Oct 19 22:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344050180 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 22:38:39.383802 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:39.384397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:39.390810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:39.391327 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:39.391759 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:39.392743 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:39.392885 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:39.393307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:39.597067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:39.605263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bf8f71c2-9ce0-4675-866d-06c68163200e tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1684 microversion: 2.1 time: 0.225250 Oct 19 22:38:39.605855 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2038/4082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:39 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1684 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:40.635134 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:40.636373 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:40.643871 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:40.644543 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:40.644880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:40.645466 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:40.645915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:40.646386 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:40.722390 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:40.731124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c57f9a0b-999f-4d80-99ce-f6654916a1f2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1616 microversion: 2.1 time: 0.100301 Oct 19 22:38:40.731861 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2045/4083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:40 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1616 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:38:40.938706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:40.939411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:40.946774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:40.947462 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:40.947951 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:40.948752 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:40.949310 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:40.949845 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:40.953968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-094d5f13-c886-492c-8a6d-f3028bf83e83 req-6f4fb656-062f-46bb-b5b4-30c71d03a4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c", "name": "network-vif-deleted", "tag": "adc429b2-7774-4b91-ba7b-31ddca952402"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:38:40.965621 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] HTTP exception thrown: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Request method failure captured: Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e HTTP/1.1 Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPjOrSHuHfDjRUlCmdI-NxfHuDXv3db4iBtYmigoHV-4qZnkDKAaSNfciMNMllsNUvcsbAqpwaO8rvl3ciMUOGuLvE8VKiDCx7GGvGHcSDXN1QDWBU3TikYRraiaQFoIlBnAAsPweESDw_3se6thJsEDoygEYa-uuNlFBIC5eRBF_M Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:40.967933 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88309b84283a4052aa1d957047390cb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88309b84283a4052aa1d957047390cb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}] Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: f9b4be7642f3441ab83cf81e1029e017 Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:40.969534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '72787a88-c3f6-432e-9ba6-ebfa6ebadb6e'} Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:40.970337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:40.971840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:40.973262 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Returning 404 to user: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:40.973696 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-21db465d-b8cd-4f4c-90d3-d8f2db8c4133 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 404 len: 111 microversion: 2.20 time: 0.039749 Oct 19 22:38:40.975008 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-094d5f13-c886-492c-8a6d-f3028bf83e83 req-6f4fb656-062f-46bb-b5b4-30c71d03a4d6 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:40.978336 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2039/4084] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 19 22:38:40 2022] DELETE /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:38:40.978444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-094d5f13-c886-492c-8a6d-f3028bf83e83 req-6f4fb656-062f-46bb-b5b4-30c71d03a4d6 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:40.978444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-094d5f13-c886-492c-8a6d-f3028bf83e83 req-6f4fb656-062f-46bb-b5b4-30c71d03a4d6 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:40.982910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:40.984507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:40.992097 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:40.993516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:40.994191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:40.994319 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-094d5f13-c886-492c-8a6d-f3028bf83e83 req-6f4fb656-062f-46bb-b5b4-30c71d03a4d6 service nova] Creating event network-vif-deleted:adc429b2-7774-4b91-ba7b-31ddca952402 for instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c on hv-cinder-maste Oct 19 22:38:40.995301 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:40.996281 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:40.997508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:41.001002 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-094d5f13-c886-492c-8a6d-f3028bf83e83 req-6f4fb656-062f-46bb-b5b4-30c71d03a4d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055858 Oct 19 22:38:41.001984 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2046/4085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:38:41.013913 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] HTTP exception thrown: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Request method failure captured: Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e HTTP/1.1 Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPjOrSHuHfDjRUlCmdI-NxfHuDXv3db4iBtYmigoHV-4qZnkDKAaSNfciMNMllsNUvcsbAqpwaO8rvl3ciMUOGuLvE8VKiDCx7GGvGHcSDXN1QDWBU3TikYRraiaQFoIlBnAAsPweESDw_3se6thJsEDoygEYa-uuNlFBIC5eRBF_M Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:41.015724 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88309b84283a4052aa1d957047390cb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88309b84283a4052aa1d957047390cb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}] Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: f9b4be7642f3441ab83cf81e1029e017 Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:41.017179 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '72787a88-c3f6-432e-9ba6-ebfa6ebadb6e'} Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:41.017941 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. Oct 19 22:38:41.019326 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:41.021579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Returning 404 to user: Instance 72787a88-c3f6-432e-9ba6-ebfa6ebadb6e could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:41.022318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8095c746-a5e8-4f17-a696-b1e5f6fda6c1 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e" status: 404 len: 111 microversion: 2.20 time: 0.043909 Oct 19 22:38:41.023680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2040/4086] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:40 2022] GET /compute/v2.1/servers/72787a88-c3f6-432e-9ba6-ebfa6ebadb6e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:38:41.768826 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:41.769541 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:41.778193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:41.778690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:41.779152 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:41.779860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:41.780983 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:41.781653 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:41.816043 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:41.818638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:41.818638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:41.818638 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lazy-loading 'fault' on Instance uuid 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:38:41.862229 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b6c2a1a4a248158c5abbabe61ad634', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a6de28c59e9470aa38566fdc2713ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:38:41.870303 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-d8cb116e-52c6-4426-a9a3-3111396263ff tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 200 len: 1332 microversion: 2.1 time: 0.106498 Oct 19 22:38:41.870880 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2047/4087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:41 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:38:42.281369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:42.281873 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:42.288170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:42.288655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:42.289089 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:42.289794 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:42.290245 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:42.290664 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:42.303963 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] HTTP exception thrown: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Request method failure captured: Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 HTTP/1.1 Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPjOrSHuHfDjRUlCmdI-NxfHuDXv3db4iBtYmigoHV-4qZnkDKAaSNfciMNMllsNUvcsbAqpwaO8rvl3ciMUOGuLvE8VKiDCx7GGvGHcSDXN1QDWBU3TikYRraiaQFoIlBnAAsPweESDw_3se6thJsEDoygEYa-uuNlFBIC5eRBF_M Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:42.305496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88309b84283a4052aa1d957047390cb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88309b84283a4052aa1d957047390cb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}] Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: f9b4be7642f3441ab83cf81e1029e017 Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.307101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '36e9edcd-9575-4a90-80cc-d85cdee02841'} Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:42.307803 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.308993 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.310210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Returning 404 to user: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:42.310210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-89fc2590-e229-4e3f-9011-278134e03fa5 tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 404 len: 111 microversion: 2.20 time: 0.029495 Oct 19 22:38:42.310210 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2041/4088] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Oct 19 22:38:42 2022] DELETE /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:38:42.316156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:42.316784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] [instance: 36e9edcd-9575-4a90-80cc-d85cdee02841] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:42.322946 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:42.323447 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:42.323878 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:42.324611 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:42.325059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:42.325477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:42.339870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] HTTP exception thrown: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Request method failure captured: Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 HTTP/1.1 Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPjOrSHuHfDjRUlCmdI-NxfHuDXv3db4iBtYmigoHV-4qZnkDKAaSNfciMNMllsNUvcsbAqpwaO8rvl3ciMUOGuLvE8VKiDCx7GGvGHcSDXN1QDWBU3TikYRraiaQFoIlBnAAsPweESDw_3se6thJsEDoygEYa-uuNlFBIC5eRBF_M Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:38:42.341595 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88309b84283a4052aa1d957047390cb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88309b84283a4052aa1d957047390cb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88309b84283a4052aa1d957047390cb8"}]}] Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 88309b84283a4052aa1d957047390cb8 Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-412360417 Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: f9b4be7642f3441ab83cf81e1029e017 Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeShelveTestJSON-412360417-project Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.343295 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '36e9edcd-9575-4a90-80cc-d85cdee02841'} Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:42.344037 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. Oct 19 22:38:42.345215 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.346178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] Returning 404 to user: Instance 36e9edcd-9575-4a90-80cc-d85cdee02841 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:42.346178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-67808dbf-e58e-47ba-a373-530d141a637b tempest-AttachVolumeShelveTestJSON-412360417 tempest-AttachVolumeShelveTestJSON-412360417-project] 10.222.0.20 "GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841" status: 404 len: 111 microversion: 2.20 time: 0.030656 Oct 19 22:38:42.346178 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2048/4089] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Oct 19 22:38:42 2022] GET /compute/v2.1/servers/36e9edcd-9575-4a90-80cc-d85cdee02841 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 22:38:42.894016 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:42.894663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:42.900725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:42.901213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:42.901652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:42.902349 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:42.902812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:42.903277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:42.916519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c HTTP/1.1 Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:42.918052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:42.919536 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c'} Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:42.920259 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:42.921362 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:42.922385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:42.922385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e4b3c267-b191-4498-867f-4bf48f5e226a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 404 len: 111 microversion: 2.1 time: 0.029961 Oct 19 22:38:42.922385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2042/4090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:42 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:42.930632 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-8295039d-ebf8-42e0-88bf-156d9cd1d0cd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '.version_select at 0x7f7332efeb80>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:43.013507 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-8295039d-ebf8-42e0-88bf-156d9cd1d0cd tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077667449" status: 202 len: 0 microversion: 2.1 time: 0.086566 Oct 19 22:38:43.014090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2049/4091] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Oct 19 22:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077667449 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 22:38:45.391674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:45.392192 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:45.399064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:45.399799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:45.400558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:45.401826 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:45.402385 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:45.402905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:45.418693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c HTTP/1.1 Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:45.421152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.423369 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c'} Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:45.424229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.425498 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.426840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:45.426840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5cad2fc3-6ccb-423a-922f-24443f6f79f0 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 404 len: 111 microversion: 2.1 time: 0.038222 Oct 19 22:38:45.426840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2043/4092] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:38:45 2022] DELETE /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:45.433521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:45.434128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:45.441113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:45.441598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:45.442027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:45.442704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:45.443678 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:45.444843 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:45.464404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c HTTP/1.1 Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:38:45.465952 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.468035 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c'} Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:45.468849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. Oct 19 22:38:45.470177 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:45.471397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance 6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:45.471397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2ace772a-702c-4d01-a9f1-a40b468bb9b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c" status: 404 len: 111 microversion: 2.1 time: 0.038319 Oct 19 22:38:45.471397 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2050/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:45 2022] GET /compute/v2.1/servers/6b0fcf95-4eef-4041-8c5b-f95f0cc2f24c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:46.778854 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:46.780567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:46.788273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.792730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.792730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.792730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.792730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.793250 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.806152 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 HTTP/1.1 Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:46.807793 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.809303 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'f1afd0c9-fe0b-4d41-a64e-d8f1e4206920'} Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:46.810168 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.811652 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.813228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:46.813228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-1310b112-e692-4b06-a01a-de01e6a10451 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 404 len: 111 microversion: 2.1 time: 0.036140 Oct 19 22:38:46.813228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2044/4094] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:38:46 2022] DELETE /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:46.817784 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:46.821530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: f1afd0c9-fe0b-4d41-a64e-d8f1e4206920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:46.824992 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.825477 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.825915 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.826690 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.827341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.827767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.841320 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 HTTP/1.1 Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:38:46.843418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.845700 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': 'f1afd0c9-fe0b-4d41-a64e-d8f1e4206920'} Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:46.846614 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. Oct 19 22:38:46.847780 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.849381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:46.849381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-801059d7-1029-41c9-a8f5-6ca6f76901b7 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920" status: 404 len: 111 microversion: 2.1 time: 0.030932 Oct 19 22:38:46.849381 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2051/4095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:46 2022] GET /compute/v2.1/servers/f1afd0c9-fe0b-4d41-a64e-d8f1e4206920 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 22:38:46.853228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:46.853727 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:46.860207 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.860688 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.861129 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.861812 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.862263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.862685 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.876413 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc HTTP/1.1 Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:46.878096 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.879318 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': '47e0e488-cb92-478d-8aa4-357c3773dedc'} Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:46.880037 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.881642 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.883758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:46.883758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-944775c6-484a-44dc-a0b2-7f37037945e6 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 404 len: 111 microversion: 2.1 time: 0.030103 Oct 19 22:38:46.883758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2045/4096] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:38:46 2022] DELETE /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:46.893056 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:46.893745 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: 47e0e488-cb92-478d-8aa4-357c3773dedc] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:46.899844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.902195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.902195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.902195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:46.902195 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:46.902490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:46.917860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc HTTP/1.1 Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:38:46.919476 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.921341 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': '47e0e488-cb92-478d-8aa4-357c3773dedc'} Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:46.922055 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. Oct 19 22:38:46.923155 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:46.924133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance 47e0e488-cb92-478d-8aa4-357c3773dedc could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:46.924133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-2aab26d2-0080-4cd5-927c-814d0f538c9a tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc" status: 404 len: 111 microversion: 2.1 time: 0.032317 Oct 19 22:38:46.925335 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2052/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:46 2022] GET /compute/v2.1/servers/47e0e488-cb92-478d-8aa4-357c3773dedc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:48.262625 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:48.263162 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:48.270449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:48.271064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:48.271707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:48.272490 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:48.273052 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:48.273545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:48.287954 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: DELETE /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 HTTP/1.1 Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:38:48.289575 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.293887 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'ca4d839a-a9cb-470c-b01b-b634c0057dd2'} Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:48.294932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.296842 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.298176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:48.298176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6b768bd7-66b7-4b33-8233-93faf3133b54 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 404 len: 111 microversion: 2.1 time: 0.032181 Oct 19 22:38:48.298176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2046/4098] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:38:48 2022] DELETE /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:38:48.299971 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:38:48.300577 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] [instance: ca4d839a-a9cb-470c-b01b-b634c0057dd2] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:38:48.306706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:48.307219 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:48.307659 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:48.308408 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:38:48.308801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:38:48.309357 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:38:48.323626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] HTTP exception thrown: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Request method failure captured: Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 HTTP/1.1 Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHPmPwMixGJ54MO2-YNbNdywEJmBI9pDIlNJBRKPeMeSGvehU8xoTwaT_X9r9bpV__IHC8mxFVm36Gf-8xnkxqftpWYV-MptBGfQVfg3kup0YUX_GY2UatAame2dBwaQPiPklrXnn-0dCrdLBDJmBleobnYIDcVEz1alxRd4C5_JXhE Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:38:48.325330 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a6de28c59e9470aa38566fdc2713ba0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a6de28c59e9470aa38566fdc2713ba0"}]}] Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 0a6de28c59e9470aa38566fdc2713ba0 Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824286954 Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 57b6c2a1a4a248158c5abbabe61ad634 Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-AttachVolumeNegativeTest-824286954-project Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.326941 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': 'ca4d839a-a9cb-470c-b01b-b634c0057dd2'} Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:38:48.327768 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. Oct 19 22:38:48.328921 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:38:48.330159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] Returning 404 to user: Instance ca4d839a-a9cb-470c-b01b-b634c0057dd2 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:38:48.330159 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c8a8f51a-edb1-4169-a194-eabea35a1cc2 tempest-AttachVolumeNegativeTest-824286954 tempest-AttachVolumeNegativeTest-824286954-project] 10.222.0.20 "GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2" status: 404 len: 111 microversion: 2.1 time: 0.031106 Oct 19 22:38:48.330739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2053/4099] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:38:48 2022] GET /compute/v2.1/servers/ca4d839a-a9cb-470c-b01b-b634c0057dd2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:39:25.480955 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:25.481567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:25.483749 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:39:25.484396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:39:25.489839 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:25.494226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:25.494226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:25.494226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:25.494226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:25.494740 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:25.517737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:39:25.836367 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e7e173a5-41df-490e-9cd2-0766051f0fd1 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 204 len: 0 microversion: 2.1 time: 0.358907 Oct 19 22:39:25.836953 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2047/4100] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:39:25 2022] DELETE /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 22:39:25.851990 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:25.852630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:25.854903 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:39:25.855578 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:39:25.860301 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:25.860719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:25.861222 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:25.862469 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:25.862925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:25.863377 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:25.997573 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:26.005570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cb47d2a0-712e-4255-8e11-c7e7425d1be0 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1576 microversion: 2.1 time: 0.157430 Oct 19 22:39:26.006136 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2054/4101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:25 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:27.029783 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:27.030520 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:27.036804 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:27.037288 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:27.037725 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:27.038441 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:27.038911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:27.039387 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:27.175906 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:27.183449 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-8a7717e3-b45f-449d-baef-a174b3a926eb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1576 microversion: 2.1 time: 0.158221 Oct 19 22:39:27.184003 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2048/4102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:27 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:28.208039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:28.209214 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:28.219304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:28.219951 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:28.221270 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:28.222571 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:28.223237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:28.224003 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:28.327844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:28.335968 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-91be357f-3b02-415b-b1b7-7bd04909460a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1509 microversion: 2.1 time: 0.133127 Oct 19 22:39:28.347133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2055/4103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:28 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1509 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:28.553400 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-0cdb50ca-fab3-4d0e-a055-60867209307c req-ab5d2d10-683e-40f0-9872-17db7ad79507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd41f7ab-aba7-42df-b4a3-b4c3009c4920", "name": "network-vif-deleted", "tag": "7a6d435c-73c6-46f6-ba71-be435a81e2dc"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:39:28.566984 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-0cdb50ca-fab3-4d0e-a055-60867209307c req-ab5d2d10-683e-40f0-9872-17db7ad79507 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:28.567859 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-0cdb50ca-fab3-4d0e-a055-60867209307c req-ab5d2d10-683e-40f0-9872-17db7ad79507 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:28.568109 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-0cdb50ca-fab3-4d0e-a055-60867209307c req-ab5d2d10-683e-40f0-9872-17db7ad79507 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:28.579905 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-0cdb50ca-fab3-4d0e-a055-60867209307c req-ab5d2d10-683e-40f0-9872-17db7ad79507 service nova] Creating event network-vif-deleted:7a6d435c-73c6-46f6-ba71-be435a81e2dc for instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 on hv-cinder-maste Oct 19 22:39:28.586234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-0cdb50ca-fab3-4d0e-a055-60867209307c req-ab5d2d10-683e-40f0-9872-17db7ad79507 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036911 Oct 19 22:39:28.587007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2049/4104] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:39:29.360050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:29.360656 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:29.371957 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:29.372776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:29.373218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:29.373998 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:29.374459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:29.374879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:29.410090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:29.410757 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:29.411799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:29.412455 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lazy-loading 'fault' on Instance uuid bd41f7ab-aba7-42df-b4a3-b4c3009c4920 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:39:29.468937 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:29.478485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-98a5a65f-cfe3-47e5-928d-75c922ef7e95 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 200 len: 1230 microversion: 2.1 time: 0.122170 Oct 19 22:39:29.479114 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2056/4105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:29 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 1230 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:30.502734 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:30.503465 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:30.509560 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:30.510082 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:30.510529 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:30.511251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:30.511773 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:30.512204 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:30.526186 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] HTTP exception thrown: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Request method failure captured: Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 HTTP/1.1 Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHoI-ENkCsOCNhrBFkMKwtxT4Jb_e-qkWhDV3vNKmR_bT-q2LLgqT38Vg2oTy_sg0tPJDm053acs9viCfDOndtQvore7Bu6dbhOfYmpFGbddCxlV9V2IC-nEXu68Wzx_BLK_GeL1N6WS-k5OYvMzR9IM47PVQG_JIO8xjS6l7rQxp2c Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:39:30.527840 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}] Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-TestVolumeBootPattern-579931785 Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 690632c6d7494c22997ac41257ad32ff Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:39:30.529282 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'bd41f7ab-aba7-42df-b4a3-b4c3009c4920'} Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:39:30.530191 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:39:30.532234 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:39:30.534208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Returning 404 to user: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:39:30.534208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-179f59ae-5f54-42b4-a2d8-53a59c44b317 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 404 len: 111 microversion: 2.1 time: 0.031235 Oct 19 22:39:30.534208 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2050/4106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:30 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:39:30.664842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-478984841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174103779", "security_groups": [{"name": "tempest-secgroup-smoke-309554937"}], "block_device_mapping_v2": [{"uuid": "2747d8bc-6665-4b8e-8aad-1f44df889afe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bde96250-97af-4607-a230-ada090eb596a"}]}} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:39:30.776719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.network.neutron [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] validate_networks() for [('bde96250-97af-4607-a230-ada090eb596a', None, None, None, None, None)] {{(pid=121022) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:39:31.253905 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Flavor limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:39:31.254332 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Image limits 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:39:31.254806 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Flavor pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:39:31.255462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Image pref 0:0:0 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:39:31.256939 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.virt.hardware [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121022) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:39:31.268736 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:31.269179 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:31.269615 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:31.270338 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:31.270792 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:31.271248 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:31.287808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for project 9b8d72b42f384b4a9933c4648913857c. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:39:31.291688 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.quota [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for user 690632c6d7494c22997ac41257ad32ff and project 9b8d72b42f384b4a9933c4648913857c. Resources: {'instances', 'ram', 'cores'} {{(pid=121022) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:39:31.354944 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Going to run 1 instances... {{(pid=121022) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:39:31.357150 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2747d8bc-6665-4b8e-8aad-1f44df889afe',volume_size=None,volume_type=None)] {{(pid=121022) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:39:31.818327 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9086f2fc-5f11-4327-a2aa-f59fb44aade4 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.157338 Oct 19 22:39:31.824627 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2057/4107] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:39:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:39:31.830032 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7fdb624d-44b6-4563-ad3a-662cb07be337 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:31.830645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7fdb624d-44b6-4563-ad3a-662cb07be337 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:31.885357 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7fdb624d-44b6-4563-ad3a-662cb07be337 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:31.892170 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7fdb624d-44b6-4563-ad3a-662cb07be337 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1094 microversion: 2.1 time: 0.065979 Oct 19 22:39:31.892729 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2051/4108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:31 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:32.918233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:32.918233 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:32.923759 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:32.924283 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:32.924724 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:32.925415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:32.925870 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:32.926302 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:32.993767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:33.001938 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c6bd4b10-9d8b-4be8-a242-08bfda9d35d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1144 microversion: 2.1 time: 0.090252 Oct 19 22:39:33.002504 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2058/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:32 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:34.025047 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:34.025657 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:34.033033 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:34.033516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:34.033980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:34.034655 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:34.035645 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:34.036067 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:34.094880 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:34.103146 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7d043296-d7f5-4cfd-9063-8680dc879e5d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1144 microversion: 2.1 time: 0.081901 Oct 19 22:39:34.103707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2052/4110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:34 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:35.125443 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:35.126053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:35.133145 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:35.133810 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:35.134275 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:35.135027 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:35.135564 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:35.136082 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:35.201212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:35.208702 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-1b5cd07d-676c-48f4-a671-d09247b37782 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1192 microversion: 2.1 time: 0.087172 Oct 19 22:39:35.209255 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2059/4111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:35 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:36.232884 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:36.239566 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:36.241578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:36.242232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:36.242836 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:36.243567 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:36.244229 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:36.244841 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:36.323027 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:36.330746 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-880d1ca4-eeb9-4fd2-a4be-db5090f15931 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1210 microversion: 2.1 time: 0.101842 Oct 19 22:39:36.333038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2053/4112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:36 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:37.354419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:37.355047 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:37.368815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:37.368815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:37.368815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:37.368815 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:37.369293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:37.369293 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:37.625404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:37.633626 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-90e70192-02db-4f47-92f8-1d611f5f2525 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.282941 Oct 19 22:39:37.634183 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2060/4113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:37 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:37.955878 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-4ca4ca5f-28f2-4565-b68f-c5ff671ebf2d req-c867d303-a666-490b-81bc-7e1f705e141f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b993e3c9-0c41-4fb2-ba5a-1fba160ab456", "tag": "3e6c8428-3d46-4a73-8445-2500e6f11cff"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:39:37.965599 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-4ca4ca5f-28f2-4565-b68f-c5ff671ebf2d req-c867d303-a666-490b-81bc-7e1f705e141f service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:37.966069 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-4ca4ca5f-28f2-4565-b68f-c5ff671ebf2d req-c867d303-a666-490b-81bc-7e1f705e141f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:37.966519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-4ca4ca5f-28f2-4565-b68f-c5ff671ebf2d req-c867d303-a666-490b-81bc-7e1f705e141f service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:37.977789 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-4ca4ca5f-28f2-4565-b68f-c5ff671ebf2d req-c867d303-a666-490b-81bc-7e1f705e141f service nova] Creating event network-changed:3e6c8428-3d46-4a73-8445-2500e6f11cff for instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 on hv-cinder-maste Oct 19 22:39:37.982849 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-4ca4ca5f-28f2-4565-b68f-c5ff671ebf2d req-c867d303-a666-490b-81bc-7e1f705e141f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030577 Oct 19 22:39:37.984011 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2054/4114] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:39:38.662039 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:38.662647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:38.669362 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:38.673053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:38.673053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:38.673053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:38.673053 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:38.673393 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:38.816415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:38.824770 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-40a013cf-9d48-43b7-be31-f51bedeb5219 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.167288 Oct 19 22:39:38.825360 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2061/4115] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:38 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:39.850705 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:39.855157 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:39.857956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:39.858392 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:39.858830 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:39.859579 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:39.860035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:39.860453 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:40.082561 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:40.090772 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d72265f7-c372-4d7b-baaa-e9b59641f890 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.245458 Oct 19 22:39:40.091556 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2055/4116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:39 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:41.114065 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:41.114707 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:41.120855 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:41.121415 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:41.121842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:41.122523 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:41.123061 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:41.123490 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:41.269831 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:41.278173 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9ec7093c-77aa-42ab-b06c-000a6d4fbca9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.168448 Oct 19 22:39:41.278988 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2062/4117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:41 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:42.380736 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:42.381338 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:42.383957 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:39:42.389270 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:42.389817 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:42.390305 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:42.391185 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:42.391785 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:42.392355 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:42.537443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:42.545681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-77c71436-c92a-403a-a3bd-e13f385bf4fb tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.169652 Oct 19 22:39:42.546263 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2056/4118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:42 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:43.569496 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:43.570113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:43.572250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:39:43.573112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=6 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:39:43.578464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:43.578974 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:43.579436 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:43.580137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:43.580647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:43.581129 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:43.727020 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:43.734856 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-85e8cb97-c3ad-48de-b94c-f60d09fcb971 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.169773 Oct 19 22:39:43.735454 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2063/4119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:43 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:44.916588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:44.917200 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:44.923182 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:44.923668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:44.926042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:44.926042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:44.926042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:44.926042 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:45.054337 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:45.061902 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-eec32d07-57fd-452c-a38c-9d4a1942fc9c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.308467 Oct 19 22:39:45.062476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2057/4120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:44 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:46.084392 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:46.085212 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:46.092128 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:46.092652 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:46.093251 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:46.094093 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:46.094549 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:46.094979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:46.227311 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:46.235001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-7b57646e-1d10-4f07-b498-2a5d369fe3af tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.154794 Oct 19 22:39:46.240434 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2064/4121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:46 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:47.259945 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:47.261411 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:47.280588 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:47.281398 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:47.282059 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:47.283213 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:47.283828 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:47.284666 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:47.477256 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:47.485643 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-acb537d5-9d10-4c4d-b56c-5bb0f929020d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.231292 Oct 19 22:39:47.486632 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2058/4122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:47 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:48.512877 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:48.513776 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:48.521137 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:48.521701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:48.522383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:48.523475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:48.526276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:48.530021 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:48.688568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:48.696976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-e6c64dd3-8831-40dc-9242-ef720e70afb8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.188856 Oct 19 22:39:48.697552 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2065/4123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:48 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:48.822558 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-d6d1d406-7837-4074-85e8-ee23e16aa6c2 req-1a78bf6a-ffb9-443f-8965-ac422044129a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b993e3c9-0c41-4fb2-ba5a-1fba160ab456", "name": "network-vif-plugged", "status": "completed", "tag": "3e6c8428-3d46-4a73-8445-2500e6f11cff"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:39:48.833808 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-d6d1d406-7837-4074-85e8-ee23e16aa6c2 req-1a78bf6a-ffb9-443f-8965-ac422044129a service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:48.834273 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-d6d1d406-7837-4074-85e8-ee23e16aa6c2 req-1a78bf6a-ffb9-443f-8965-ac422044129a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:48.834697 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-d6d1d406-7837-4074-85e8-ee23e16aa6c2 req-1a78bf6a-ffb9-443f-8965-ac422044129a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:48.845844 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-d6d1d406-7837-4074-85e8-ee23e16aa6c2 req-1a78bf6a-ffb9-443f-8965-ac422044129a service nova] Creating event network-vif-plugged:3e6c8428-3d46-4a73-8445-2500e6f11cff for instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 on hv-cinder-maste Oct 19 22:39:48.850935 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-d6d1d406-7837-4074-85e8-ee23e16aa6c2 req-1a78bf6a-ffb9-443f-8965-ac422044129a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Oct 19 22:39:48.851634 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2059/4124] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:39:49.721070 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:49.722404 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:49.728900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:49.729384 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:49.729822 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:49.730514 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:49.730991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:49.731418 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:49.866288 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:49.874158 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-9d7af351-3f4b-48dd-a201-4682053a5dec tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.156909 Oct 19 22:39:49.874683 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2066/4125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:49 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:50.896537 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:50.897258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:50.904077 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:50.904598 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:50.905040 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:50.905732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:50.906203 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:50.906659 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:51.042264 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:51.050851 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-33d796b2-7e48-457e-ab8b-d43eddf4e20e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1265 microversion: 2.1 time: 0.158502 Oct 19 22:39:51.051443 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2060/4126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:50 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:52.073517 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:52.074130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:52.080459 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:52.080945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:52.081376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:52.082059 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:52.082511 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:52.082934 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:52.223739 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:52.232123 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-836936df-d300-4b93-84b7-50dbb2a519d9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1451 microversion: 2.1 time: 0.162444 Oct 19 22:39:52.232799 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2067/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:52 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:52.255294 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:39:52.256143 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:39:52.262409 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:52.262890 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:52.263401 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:52.264094 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:52.264551 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:52.264975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:52.436251 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:39:52.445998 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d9569933-7b31-4acc-84fd-e9d8a8f46c8d tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1451 microversion: 2.1 time: 0.195107 Oct 19 22:39:52.446997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2061/4128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:39:52 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1451 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:39:54.490276 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-9715fdde-e8c2-480d-b844-c2a78b6821a6 req-5040f674-6221-4683-83f1-7391e079ff42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b993e3c9-0c41-4fb2-ba5a-1fba160ab456", "tag": "3e6c8428-3d46-4a73-8445-2500e6f11cff"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:39:54.501054 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-9715fdde-e8c2-480d-b844-c2a78b6821a6 req-5040f674-6221-4683-83f1-7391e079ff42 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:39:54.501527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-9715fdde-e8c2-480d-b844-c2a78b6821a6 req-5040f674-6221-4683-83f1-7391e079ff42 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:39:54.501953 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-9715fdde-e8c2-480d-b844-c2a78b6821a6 req-5040f674-6221-4683-83f1-7391e079ff42 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:39:54.514682 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-9715fdde-e8c2-480d-b844-c2a78b6821a6 req-5040f674-6221-4683-83f1-7391e079ff42 service nova] Creating event network-changed:3e6c8428-3d46-4a73-8445-2500e6f11cff for instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 on hv-cinder-maste Oct 19 22:39:54.521273 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-9715fdde-e8c2-480d-b844-c2a78b6821a6 req-5040f674-6221-4683-83f1-7391e079ff42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035774 Oct 19 22:39:54.521805 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2068/4129] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:41:52.334429 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:41:52.334975 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 19 22:41:52.336063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:41:52.336063 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 19 22:41:52.336658 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:41:52.337774 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:41:52.342055 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1108695606", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1174103779", "security_groups": [{"name": "tempest-secgroup-smoke-309554937"}], "block_device_mapping_v2": [{"uuid": "707655e7-46e9-47d5-bb8c-89db98ac7641", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bde96250-97af-4607-a230-ada090eb596a"}]}} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:41:52.619013 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.network.neutron [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] validate_networks() for [('bde96250-97af-4607-a230-ada090eb596a', None, None, None, None, None)] {{(pid=121021) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 22:41:53.070166 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Flavor limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 22:41:53.070584 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Image limits 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 22:41:53.071101 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Flavor pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 22:41:53.071505 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Image pref 0:0:0 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 22:41:53.071910 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.virt.hardware [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 22:41:53.080787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:53.081277 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:53.081717 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:53.082473 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:53.082931 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:53.083382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:53.100747 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for project 9b8d72b42f384b4a9933c4648913857c. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 22:41:53.104707 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.quota [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Getting quotas for user 690632c6d7494c22997ac41257ad32ff and project 9b8d72b42f384b4a9933c4648913857c. Resources: {'instances', 'ram', 'cores'} {{(pid=121021) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 22:41:53.159730 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Going to run 1 instances... {{(pid=121021) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 22:41:53.162370 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='707655e7-46e9-47d5-bb8c-89db98ac7641',volume_size=None,volume_type=None)] {{(pid=121021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 22:41:53.601382 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-e0f0c13c-cfd5-4aa1-af61-6d9c5faa8193 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.269589 Oct 19 22:41:53.602144 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2062/4130] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Oct 19 22:41:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 22:41:53.611701 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7fed87e8-26b4-410b-8455-b08e38f2b579] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 22:41:53.612317 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:41:53.612462 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:41:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 (ip 10.222.0.20) !!! Oct 19 22:41:53.613909 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 22:41:53.614032 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Wed Oct 19 22:41:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 (ip 10.222.0.20) !!! Oct 19 22:41:53.615113 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:41:53.615841 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=84 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:41:53.620001 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-cf4b2af0-3ee2-4f61-8498-870d28ec31bd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:41:53.620704 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-cf4b2af0-3ee2-4f61-8498-870d28ec31bd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:41:53.743435 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-cf4b2af0-3ee2-4f61-8498-870d28ec31bd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:41:53.750279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-cf4b2af0-3ee2-4f61-8498-870d28ec31bd tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1095 microversion: 2.1 time: 0.140831 Oct 19 22:41:53.750838 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2069/4131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:41:53 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1095 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:41:54.772911 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:41:54.773524 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:41:54.780140 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:54.780628 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:54.781072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:54.781763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:54.782225 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:54.782651 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:54.845458 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:41:54.853737 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-6b22c8bd-03dc-43e7-a554-266258d3d22b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1137 microversion: 2.1 time: 0.084707 Oct 19 22:41:54.854396 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2063/4132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:41:54 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:41:55.877347 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:41:55.878087 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:41:55.889522 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO oslo.messaging._drivers.impl_rabbit [-] [7fed87e8-26b4-410b-8455-b08e38f2b579] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46576. Oct 19 22:41:55.895218 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:55.895706 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:55.896201 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:55.896893 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:55.897345 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:55.897760 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:55.973796 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:41:55.981202 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6403f23-7460-4c2b-91d5-8d47f116c68b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1211 microversion: 2.1 time: 0.108387 Oct 19 22:41:55.981772 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2070/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:41:55 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:41:57.006924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:41:57.007946 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:41:57.015258 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:57.015663 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:57.016098 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:57.016799 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:57.017252 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:57.017681 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:57.156723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:41:57.164501 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-bdf60c45-e25e-43e6-9ec9-8439880dfb54 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1278 microversion: 2.1 time: 0.163784 Oct 19 22:41:57.165072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2064/4134] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:41:56 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 22:41:57.387681 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-7a67125f-6255-4e39-a295-b791f6a3457b req-3391becb-c024-43c1-8afd-28a5f6235bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66d92d1-d335-4bf5-827f-978e0e35fe85", "tag": "f4f959ba-69c3-4296-bde8-ab125b00bdfe"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:41:57.397133 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-7a67125f-6255-4e39-a295-b791f6a3457b req-3391becb-c024-43c1-8afd-28a5f6235bf4 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:57.397598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-7a67125f-6255-4e39-a295-b791f6a3457b req-3391becb-c024-43c1-8afd-28a5f6235bf4 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:57.398033 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-7a67125f-6255-4e39-a295-b791f6a3457b req-3391becb-c024-43c1-8afd-28a5f6235bf4 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:57.409151 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-7a67125f-6255-4e39-a295-b791f6a3457b req-3391becb-c024-43c1-8afd-28a5f6235bf4 service nova] Creating event network-changed:f4f959ba-69c3-4296-bde8-ab125b00bdfe for instance c66d92d1-d335-4bf5-827f-978e0e35fe85 on hv-cinder-maste Oct 19 22:41:57.414058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-7a67125f-6255-4e39-a295-b791f6a3457b req-3391becb-c024-43c1-8afd-28a5f6235bf4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092882 Oct 19 22:41:57.414639 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2071/4135] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:41:58.188780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:41:58.189394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:41:58.196418 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:58.196907 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:58.197348 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:58.198038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:58.198503 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:58.198927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:58.333653 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:41:58.342104 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c2211e94-5ca6-4538-85fe-e45d88438589 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.157299 Oct 19 22:41:58.342680 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2065/4136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:41:58 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:41:59.365975 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:41:59.366669 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:41:59.372844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:59.373367 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:59.373786 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:59.374474 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:41:59.374925 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:41:59.375372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:41:59.503225 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:41:59.511090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-b6480f64-0d41-4222-a370-7c8a72b10eba tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.150390 Oct 19 22:41:59.511655 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2072/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:41:59 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:00.533639 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:00.534276 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:00.541249 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:00.541732 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:00.542172 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:00.542869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:00.543346 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:00.543771 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:00.671476 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:00.679614 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ca518cde-079d-4764-b420-fb377d1eb4e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.149867 Oct 19 22:42:00.680176 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2066/4138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:00 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:01.702062 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:01.702694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:01.709131 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:01.709604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:01.710036 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:01.710717 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:01.711188 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:01.711607 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:01.838735 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:01.846112 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-652b1216-f27b-4a72-a8af-8bc9c4dc627a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.147932 Oct 19 22:42:01.846662 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2073/4139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:01 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:02.869174 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:02.869728 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:02.876467 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:02.876956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:02.877397 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:02.878086 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:02.878545 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:02.878996 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:03.008300 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:03.015962 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-671c021c-a960-4d3a-8d81-c2e6bf1b0a39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.151374 Oct 19 22:42:03.016531 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2067/4140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:02 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:04.039382 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:04.039932 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:04.042318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell0:SELECT=2 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:42:04.047076 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:04.047555 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:04.047985 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:04.048694 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:04.049193 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:04.049570 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:04.181505 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:04.188973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c34a0f86-78ff-4feb-b7e4-e13110711f2a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.154085 Oct 19 22:42:04.189527 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2074/4141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:04 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:05.211324 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:05.212233 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:05.214062 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=2 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:42:05.214706 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell0:SELECT=6 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:42:05.220005 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:05.220489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:05.220926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:05.221618 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:05.222072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:05.222496 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:05.352469 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:05.360038 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-5f7ccfc9-4b8d-4593-b3a8-2eeecd338f04 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.152496 Oct 19 22:42:05.360538 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2068/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:05 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:06.383989 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:06.384521 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:06.390973 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:06.391471 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:06.391906 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:06.392590 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:06.393046 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:06.393475 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:06.520991 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:06.528526 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3dda56ce-75b8-47d5-877f-04a2a6d8b101 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.149231 Oct 19 22:42:06.529080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2075/4143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:06 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:07.551700 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:07.552307 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:07.558226 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:07.560434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:07.560434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:07.560434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:07.560434 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:07.560818 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:07.691982 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:07.700956 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-32380e2e-af65-4daa-ac8c-cf6600c1d59f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.153293 Oct 19 22:42:07.701606 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2069/4144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:07 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:07.715250 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-39d079d5-cc22-4863-a969-0ba7fcdc2a3d req-7ae1c871-12be-4819-808f-68f5cb7e4a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66d92d1-d335-4bf5-827f-978e0e35fe85", "name": "network-vif-plugged", "status": "completed", "tag": "f4f959ba-69c3-4296-bde8-ab125b00bdfe"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:42:07.724553 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-39d079d5-cc22-4863-a969-0ba7fcdc2a3d req-7ae1c871-12be-4819-808f-68f5cb7e4a0a service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:07.725022 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-39d079d5-cc22-4863-a969-0ba7fcdc2a3d req-7ae1c871-12be-4819-808f-68f5cb7e4a0a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:07.725444 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-39d079d5-cc22-4863-a969-0ba7fcdc2a3d req-7ae1c871-12be-4819-808f-68f5cb7e4a0a service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:07.736376 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-39d079d5-cc22-4863-a969-0ba7fcdc2a3d req-7ae1c871-12be-4819-808f-68f5cb7e4a0a service nova] Creating event network-vif-plugged:f4f959ba-69c3-4296-bde8-ab125b00bdfe for instance c66d92d1-d335-4bf5-827f-978e0e35fe85 on hv-cinder-maste Oct 19 22:42:07.742156 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-39d079d5-cc22-4863-a969-0ba7fcdc2a3d req-7ae1c871-12be-4819-808f-68f5cb7e4a0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086460 Oct 19 22:42:07.742916 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2076/4145] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:42:08.724744 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:08.725377 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:08.731997 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:08.732477 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:08.732909 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:08.733587 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:08.734035 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:08.734459 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:08.866114 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:08.873677 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-c50b6041-384f-4703-9b8e-505da22eb9d5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1266 microversion: 2.1 time: 0.153510 Oct 19 22:42:08.874232 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2070/4146] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:08 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:09.898536 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:09.899247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:09.905318 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:09.905802 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:09.906242 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:09.906924 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:09.907406 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:09.907829 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:10.037349 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:10.045197 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3a61da07-44e3-45a1-ab4f-08b3c2d774ca tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1453 microversion: 2.1 time: 0.151841 Oct 19 22:42:10.045692 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2077/4147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:09 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:10.067093 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:42:10.067710 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:42:10.074007 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:10.074495 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:10.074980 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:10.075668 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:10.076123 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:10.076549 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:10.203286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:42:10.211552 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-7a4f1b69-2363-4acb-af8e-1c4514f36877 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1453 microversion: 2.1 time: 0.148338 Oct 19 22:42:10.212391 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2071/4148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:42:10 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:42:12.199844 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-f932deab-8e48-4c6d-94b1-75c6efa086dc req-5ff2f751-d497-4239-b88d-a9d5085a2f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66d92d1-d335-4bf5-827f-978e0e35fe85", "tag": "f4f959ba-69c3-4296-bde8-ab125b00bdfe"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:42:12.209387 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-f932deab-8e48-4c6d-94b1-75c6efa086dc req-5ff2f751-d497-4239-b88d-a9d5085a2f95 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:42:12.209860 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-f932deab-8e48-4c6d-94b1-75c6efa086dc req-5ff2f751-d497-4239-b88d-a9d5085a2f95 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:42:12.210290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-f932deab-8e48-4c6d-94b1-75c6efa086dc req-5ff2f751-d497-4239-b88d-a9d5085a2f95 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:42:12.221379 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-f932deab-8e48-4c6d-94b1-75c6efa086dc req-5ff2f751-d497-4239-b88d-a9d5085a2f95 service nova] Creating event network-changed:f4f959ba-69c3-4296-bde8-ab125b00bdfe for instance c66d92d1-d335-4bf5-827f-978e0e35fe85 on hv-cinder-maste Oct 19 22:42:12.226503 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-f932deab-8e48-4c6d-94b1-75c6efa086dc req-5ff2f751-d497-4239-b88d-a9d5085a2f95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086784 Oct 19 22:42:12.230491 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2078/4149] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:43:42.280928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:43:42.280928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG dbcounter [-] [121021] Writing DB stats nova_cell1:SELECT=56 {{(pid=121021) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:43:42.280928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 22:43:42.280928 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Wed Oct 19 22:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 (ip 10.222.0.20) !!! Oct 19 22:43:42.284375 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-484ac8ed-74b7-447d-a361-46f3c0fe53de req-66b883bf-5c3a-4d24-b124-43aa484d55ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66d92d1-d335-4bf5-827f-978e0e35fe85", "tag": "f4f959ba-69c3-4296-bde8-ab125b00bdfe"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:43:42.286045 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:42.286540 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:42.290428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_api:SELECT=22 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:43:42.291090 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG dbcounter [-] [121022] Writing DB stats nova_cell1:SELECT=42 {{(pid=121022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 22:43:42.296293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:42.296810 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:42.297236 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:42.297419 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-484ac8ed-74b7-447d-a361-46f3c0fe53de req-66b883bf-5c3a-4d24-b124-43aa484d55ef service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:42.297900 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-484ac8ed-74b7-447d-a361-46f3c0fe53de req-66b883bf-5c3a-4d24-b124-43aa484d55ef service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:42.298012 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:42.298329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-484ac8ed-74b7-447d-a361-46f3c0fe53de req-66b883bf-5c3a-4d24-b124-43aa484d55ef service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:42.298433 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:42.298787 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:42.310023 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-484ac8ed-74b7-447d-a361-46f3c0fe53de req-66b883bf-5c3a-4d24-b124-43aa484d55ef service nova] Creating event network-changed:f4f959ba-69c3-4296-bde8-ab125b00bdfe for instance c66d92d1-d335-4bf5-827f-978e0e35fe85 on hv-cinder-maste Oct 19 22:43:42.315328 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-484ac8ed-74b7-447d-a361-46f3c0fe53de req-66b883bf-5c3a-4d24-b124-43aa484d55ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036283 Oct 19 22:43:42.316365 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2079/4150] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:43:42.331218 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Going to try to terminate instance {{(pid=121021) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:43:42.629230 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-d8cc3e28-d6c8-4edb-8d2b-1081ab7bf37b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 204 len: 0 microversion: 2.1 time: 0.352570 Oct 19 22:43:42.630733 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2072/4151] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:43:42 2022] DELETE /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:43:42.640130 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:42.640791 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:42.647976 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:42.648465 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:42.648928 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:42.649647 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:42.650104 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:42.650604 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:42.854630 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:43:42.862383 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-92681499-3439-4e6c-ace6-150a3c1d5a83 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1578 microversion: 2.1 time: 0.227331 Oct 19 22:43:42.862945 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2080/4152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:42 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1578 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:43:43.886674 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:43.887394 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:43.893850 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:43.894328 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:43.894758 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:43.896057 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:43.896507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:43.896927 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:44.033690 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:43:44.041494 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-ba8f9245-dd2f-4967-b183-4e8ba26b7b39 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1578 microversion: 2.1 time: 0.159109 Oct 19 22:43:44.042009 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2073/4153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:43 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:43:44.995340 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [req-74a76384-aa49-4940-b165-a2abb361c692 req-fd2f6f6b-d875-44c3-998c-f32b920da903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66d92d1-d335-4bf5-827f-978e0e35fe85", "name": "network-vif-deleted", "tag": "f4f959ba-69c3-4296-bde8-ab125b00bdfe"}]} {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:43:45.005695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-74a76384-aa49-4940-b165-a2abb361c692 req-fd2f6f6b-d875-44c3-998c-f32b920da903 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:45.006237 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-74a76384-aa49-4940-b165-a2abb361c692 req-fd2f6f6b-d875-44c3-998c-f32b920da903 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:45.006673 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [req-74a76384-aa49-4940-b165-a2abb361c692 req-fd2f6f6b-d875-44c3-998c-f32b920da903 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:45.017716 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.compute.server_external_events [req-74a76384-aa49-4940-b165-a2abb361c692 req-fd2f6f6b-d875-44c3-998c-f32b920da903 service nova] Creating event network-vif-deleted:f4f959ba-69c3-4296-bde8-ab125b00bdfe for instance c66d92d1-d335-4bf5-827f-978e0e35fe85 on hv-cinder-maste Oct 19 22:43:45.023080 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [req-74a76384-aa49-4940-b165-a2abb361c692 req-fd2f6f6b-d875-44c3-998c-f32b920da903 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Oct 19 22:43:45.023661 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2081/4154] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:43:45.064932 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:45.065489 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:45.072544 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:45.073026 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:45.073468 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:45.074151 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:45.074602 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:45.075091 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:45.139924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:43:45.148312 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-099dca72-54c5-4d62-9a5c-41eb750d474e tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1392 microversion: 2.1 time: 0.087424 Oct 19 22:43:45.148869 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2074/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:45 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1392 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:43:46.171995 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:46.172695 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:46.179468 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:46.184157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:46.184157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:46.184157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:46.184157 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:46.184509 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:46.212124 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:46.212598 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:46.213029 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:46.213464 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.objects.instance [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lazy-loading 'fault' on Instance uuid c66d92d1-d335-4bf5-827f-978e0e35fe85 {{(pid=121022) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 22:43:46.256143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:43:46.263879 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-0eaf5800-181f-4cc2-80aa-f41f8b66d41c tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 200 len: 1231 microversion: 2.1 time: 0.096610 Oct 19 22:43:46.267358 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2082/4156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:46 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:43:47.287534 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:47.288141 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: c66d92d1-d335-4bf5-827f-978e0e35fe85] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:47.294742 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:47.295253 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:47.295693 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:47.296408 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:47.296861 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:47.297286 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:47.310775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] HTTP exception thrown: Instance c66d92d1-d335-4bf5-827f-978e0e35fe85 could not be found. Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Request method failure captured: Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 HTTP/1.1 Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHoI-ENkCsOCNhrBFkMKwtxT4Jb_e-qkWhDV3vNKmR_bT-q2LLgqT38Vg2oTy_sg0tPJDm053acs9viCfDOndtQvore7Bu6dbhOfYmpFGbddCxlV9V2IC-nEXu68Wzx_BLK_GeL1N6WS-k5OYvMzR9IM47PVQG_JIO8xjS6l7rQxp2c Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:43:47.312425 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}] Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 690632c6d7494c22997ac41257ad32ff Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance c66d92d1-d335-4bf5-827f-978e0e35fe85 could not be found. Oct 19 22:43:47.313924 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'c66d92d1-d335-4bf5-827f-978e0e35fe85'} Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66d92d1-d335-4bf5-827f-978e0e35fe85 could not be found. Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:43:47.314819 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66d92d1-d335-4bf5-827f-978e0e35fe85 could not be found. Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66d92d1-d335-4bf5-827f-978e0e35fe85 could not be found. Oct 19 22:43:47.316248 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:47.318072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Returning 404 to user: Instance c66d92d1-d335-4bf5-827f-978e0e35fe85 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:43:47.318072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-33f27d10-da1a-4308-9c27-d548f826a21a tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85" status: 404 len: 111 microversion: 2.1 time: 0.030082 Oct 19 22:43:47.318072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2075/4157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:47 2022] GET /compute/v2.1/servers/c66d92d1-d335-4bf5-827f-978e0e35fe85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:43:50.693290 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:50.693785 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:50.695507 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-6a9937e7-a458-401c-b53d-dfee7f9ccd99 req-71ea73fa-a5ea-4997-92d3-08d6e1799c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b993e3c9-0c41-4fb2-ba5a-1fba160ab456", "tag": "3e6c8428-3d46-4a73-8445-2500e6f11cff"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:43:50.701180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:50.701668 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:50.702107 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:50.702808 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:50.703291 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:50.703719 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:50.706330 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6a9937e7-a458-401c-b53d-dfee7f9ccd99 req-71ea73fa-a5ea-4997-92d3-08d6e1799c18 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:50.707072 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6a9937e7-a458-401c-b53d-dfee7f9ccd99 req-71ea73fa-a5ea-4997-92d3-08d6e1799c18 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:50.707578 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-6a9937e7-a458-401c-b53d-dfee7f9ccd99 req-71ea73fa-a5ea-4997-92d3-08d6e1799c18 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:50.720320 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-6a9937e7-a458-401c-b53d-dfee7f9ccd99 req-71ea73fa-a5ea-4997-92d3-08d6e1799c18 service nova] Creating event network-changed:3e6c8428-3d46-4a73-8445-2500e6f11cff for instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 on hv-cinder-maste Oct 19 22:43:50.726364 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-6a9937e7-a458-401c-b53d-dfee7f9ccd99 req-71ea73fa-a5ea-4997-92d3-08d6e1799c18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Oct 19 22:43:50.727228 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2076/4158] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 22:43:50.734050 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Going to try to terminate instance {{(pid=121022) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 22:43:51.029800 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-c36e0352-a8d9-4079-afb6-5d31750526ed tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 204 len: 0 microversion: 2.1 time: 0.340159 Oct 19 22:43:51.030801 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2083/4159] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:43:50 2022] DELETE /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 22:43:51.039780 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:51.040721 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:51.047235 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:51.047947 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:51.048699 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:51.049623 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:51.050311 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:51.050823 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:51.184508 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.policy [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121021) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:43:51.192522 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-095ff68b-2131-402d-b851-9007e4cb309f tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1575 microversion: 2.1 time: 0.157439 Oct 19 22:43:51.193275 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2077/4160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:51 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:43:52.216599 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:52.217325 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:52.223697 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:52.224182 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:52.224624 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:52.225304 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:52.225756 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:52.226180 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:52.430199 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:43:52.437767 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-633c1418-4185-4a92-8c51-0e27d6aa0142 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1575 microversion: 2.1 time: 0.225384 Oct 19 22:43:52.438329 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2084/4161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:52 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:43:53.275472 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [req-05d353c0-265e-47a8-a4ea-3ea575061adf req-f6c33f90-931f-440c-a4ce-1cb4e1fe9f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b993e3c9-0c41-4fb2-ba5a-1fba160ab456", "name": "network-vif-deleted", "tag": "3e6c8428-3d46-4a73-8445-2500e6f11cff"}]} {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 22:43:53.285293 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-05d353c0-265e-47a8-a4ea-3ea575061adf req-f6c33f90-931f-440c-a4ce-1cb4e1fe9f92 service nova] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:53.285763 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-05d353c0-265e-47a8-a4ea-3ea575061adf req-f6c33f90-931f-440c-a4ce-1cb4e1fe9f92 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:53.286807 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [req-05d353c0-265e-47a8-a4ea-3ea575061adf req-f6c33f90-931f-440c-a4ce-1cb4e1fe9f92 service nova] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:53.297900 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.compute.server_external_events [req-05d353c0-265e-47a8-a4ea-3ea575061adf req-f6c33f90-931f-440c-a4ce-1cb4e1fe9f92 service nova] Creating event network-vif-deleted:3e6c8428-3d46-4a73-8445-2500e6f11cff for instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 on hv-cinder-maste Oct 19 22:43:53.302934 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [req-05d353c0-265e-47a8-a4ea-3ea575061adf req-f6c33f90-931f-440c-a4ce-1cb4e1fe9f92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031069 Oct 19 22:43:53.303519 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2078/4162] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Oct 19 22:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 22:43:53.462417 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:53.463063 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:53.469528 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:53.472072 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:53.472530 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:53.473247 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:53.473741 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:53.474198 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:53.535935 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.policy [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690632c6d7494c22997ac41257ad32ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8d72b42f384b4a9933c4648913857c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121022) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 22:43:53.543709 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-43e3a81d-5185-4613-9b6c-64cd80eb6177 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 200 len: 1225 microversion: 2.1 time: 0.086672 Oct 19 22:43:53.544279 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2085/4163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:53 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 22:43:54.566852 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:54.568148 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: b993e3c9-0c41-4fb2-ba5a-1fba160ab456] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:54.574860 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:54.575365 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:54.578926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:54.578926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:54.578926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:54.578926 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:54.591493 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] HTTP exception thrown: Instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 could not be found. Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Request method failure captured: Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 HTTP/1.1 Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHoI-ENkCsOCNhrBFkMKwtxT4Jb_e-qkWhDV3vNKmR_bT-q2LLgqT38Vg2oTy_sg0tPJDm053acs9viCfDOndtQvore7Bu6dbhOfYmpFGbddCxlV9V2IC-nEXu68Wzx_BLK_GeL1N6WS-k5OYvMzR9IM47PVQG_JIO8xjS6l7rQxp2c Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:43:54.593224 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}] Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 690632c6d7494c22997ac41257ad32ff Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 could not be found. Oct 19 22:43:54.594723 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'b993e3c9-0c41-4fb2-ba5a-1fba160ab456'} Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 could not be found. Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:43:54.595568 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 could not be found. Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 could not be found. Oct 19 22:43:54.596775 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:54.597777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Returning 404 to user: Instance b993e3c9-0c41-4fb2-ba5a-1fba160ab456 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:43:54.597777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-dcb04f7c-29b8-4978-aaee-0fdc4c821ec8 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456" status: 404 len: 111 microversion: 2.1 time: 0.032818 Oct 19 22:43:54.597777 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2079/4164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:54 2022] GET /compute/v2.1/servers/b993e3c9-0c41-4fb2-ba5a-1fba160ab456 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:43:55.364058 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:55.365143 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.compute.api [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121022) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:55.371372 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:55.371849 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:55.372280 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:55.372979 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:55.373428 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:55.373847 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG oslo_concurrency.lockutils [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:55.387650 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.wsgi [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] HTTP exception thrown: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Request method failure captured: Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: request: DELETE /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 HTTP/1.1 Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept: application/json Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Accept-Encoding: identity Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Connection: close Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Length: 0 Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Content-Type: application/json Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Host: 10.222.0.20 Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: Openstack-System-Scope: None Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: User-Agent: python-urllib3/1.26.12 Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Auth-Token: gAAAAABjUHoI-ENkCsOCNhrBFkMKwtxT4Jb_e-qkWhDV3vNKmR_bT-q2LLgqT38Vg2oTy_sg0tPJDm053acs9viCfDOndtQvore7Bu6dbhOfYmpFGbddCxlV9V2IC-nEXu68Wzx_BLK_GeL1N6WS-k5OYvMzR9IM47PVQG_JIO8xjS6l7rQxp2c Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Id: None Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Domain-Name: None Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Identity-Status: Confirmed Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Is-Admin-Project: True Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Id: default Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Domain-Name: Default Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Project-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Role: reader,member Oct 19 22:43:55.389277 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Roles: reader,member Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}] Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-Tenant-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Id: default Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Domain-Name: Default Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Id: 690632c6d7494c22997ac41257ad32ff Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: X-User-Name: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: method: > Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: exception: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.390563 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: action_args: {'id': 'bd41f7ab-aba7-42df-b4a3-b4c3009c4920'} Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:43:55.391370 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.392705 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.394568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Returning 404 to user: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. {{(pid=121022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:43:55.394568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-3d8ac549-7803-4c1e-81e7-bf70155bc86b tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 404 len: 111 microversion: 2.1 time: 0.030426 Oct 19 22:43:55.394568 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2086/4165] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Oct 19 22:43:55 2022] DELETE /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:43:55.399444 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '>' {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:55.400120 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.compute.api [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] [instance: bd41f7ab-aba7-42df-b4a3-b4c3009c4920] Fetching instance by UUID {{(pid=121021) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 22:43:55.405994 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:55.406481 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:55.406921 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:55.407631 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Acquiring lock "96479bbc-106d-47fa-b01e-302825761e12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 22:43:55.408088 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 22:43:55.408516 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG oslo_concurrency.lockutils [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Lock "96479bbc-106d-47fa-b01e-302825761e12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 22:43:55.421585 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.wsgi [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] HTTP exception thrown: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Request method failure captured: Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: request: GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 HTTP/1.1 Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept: application/json Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Accept-Encoding: identity Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Connection: close Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Length: 0 Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Content-Type: application/json Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Host: 10.222.0.20 Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: Openstack-System-Scope: None Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: User-Agent: python-urllib3/1.26.12 Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Auth-Token: gAAAAABjUHoI-ENkCsOCNhrBFkMKwtxT4Jb_e-qkWhDV3vNKmR_bT-q2LLgqT38Vg2oTy_sg0tPJDm053acs9viCfDOndtQvore7Bu6dbhOfYmpFGbddCxlV9V2IC-nEXu68Wzx_BLK_GeL1N6WS-k5OYvMzR9IM47PVQG_JIO8xjS6l7rQxp2c Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Id: None Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Domain-Name: None Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Identity-Status: Confirmed Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Is-Admin-Project: True Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Id: default Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Domain-Name: Default Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Project-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Role: reader,member Oct 19 22:43:55.423117 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Roles: reader,member Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9b8d72b42f384b4a9933c4648913857c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9b8d72b42f384b4a9933c4648913857c"}]}] Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Id: 9b8d72b42f384b4a9933c4648913857c Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-Tenant-Name: tempest-TestVolumeBootPattern-579931785 Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Id: default Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Domain-Name: Default Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Id: 690632c6d7494c22997ac41257ad32ff Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: X-User-Name: tempest-TestVolumeBootPattern-579931785-project Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: method: > Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: exception: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.424547 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: action_args: {'id': 'bd41f7ab-aba7-42df-b4a3-b4c3009c4920'} Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: {{(pid=121021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 22:43:55.425577 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. Oct 19 22:43:55.427712 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: ERROR nova.api.openstack.wsgi Oct 19 22:43:55.429064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: DEBUG nova.api.openstack.wsgi [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Returning 404 to user: Instance bd41f7ab-aba7-42df-b4a3-b4c3009c4920 could not be found. {{(pid=121021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 22:43:55.429064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: INFO nova.api.openstack.requestlog [None req-16ba817b-1721-40a4-9da1-ba14f01712e9 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920" status: 404 len: 111 microversion: 2.1 time: 0.028887 Oct 19 22:43:55.429064 dv-cinder-master-3-iscsi devstack@n-api.service[121021]: [pid: 121021|app: 0|req: 2080/4166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Oct 19 22:43:55 2022] GET /compute/v2.1/servers/bd41f7ab-aba7-42df-b4a3-b4c3009c4920 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 22:43:56.885674 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: DEBUG nova.api.openstack.wsgi [None req-ced195dc-d38f-48d0-a741-0db8bf8f71c5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] Calling method '.version_select at 0x7f733304e430>' {{(pid=121022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 22:43:57.006842 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: INFO nova.api.openstack.requestlog [None req-ced195dc-d38f-48d0-a741-0db8bf8f71c5 tempest-TestVolumeBootPattern-579931785 tempest-TestVolumeBootPattern-579931785-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1174103779" status: 202 len: 0 microversion: 2.1 time: 0.125088 Oct 19 22:43:57.007485 dv-cinder-master-3-iscsi devstack@n-api.service[121022]: [pid: 121022|app: 0|req: 2087/4167] 10.222.0.20 () {58 vars in 1263 bytes} [Wed Oct 19 22:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1174103779 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)